-- Logs begin at Mon 2022-05-16 16:53:08 UTC, end at Mon 2022-05-16 18:00:51 UTC. -- May 16 17:31:01.099731 dv-cinder-837699-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 16 17:31:01.109078 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 16 17:31:01.111147 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 17:31:01 2022] *** May 16 17:31:01.111147 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 17:31:01.111147 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 17:31:01.111147 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: nodename: dv-cinder-837699-6-iscsi May 16 17:31:01.111147 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: machine: x86_64 May 16 17:31:01.111147 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: clock source: unix May 16 17:31:01.111147 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: pcre jit disabled May 16 17:31:01.111147 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: detected number of CPU cores: 4 May 16 17:31:01.111147 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: current working directory: / May 16 17:31:01.111147 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: detected binary path: /usr/bin/uwsgi-core May 16 17:31:01.111147 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: your processes number limit is 47680 May 16 17:31:01.111900 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: your memory page size is 4096 bytes May 16 17:31:01.111900 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: detected max file descriptor number: 2048 May 16 17:31:01.111900 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: lock engine: pthread robust mutexes May 16 17:31:01.111900 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: thunder lock: enabled May 16 17:31:01.111900 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 16 17:31:01.111900 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 17:31:01.155535 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: Python main interpreter initialized at 0x5619671999c0 May 16 17:31:01.155535 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: python threads support enabled May 16 17:31:01.155535 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: your server socket listen backlog is limited to 100 connections May 16 17:31:01.155535 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: your mercy for graceful operations on workers is 90 seconds May 16 17:31:01.155945 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: mapped 403077 bytes (393 KB) for 2 cores May 16 17:31:01.155945 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: *** Operational MODE: preforking *** May 16 17:31:01.156217 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: *** uWSGI is running in multiple interpreter mode *** May 16 17:31:01.156217 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: spawned uWSGI master process (pid: 103631) May 16 17:31:01.156430 dv-cinder-837699-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 16 17:31:01.160409 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: spawned uWSGI worker 1 (pid: 103636, cores: 1) May 16 17:31:01.160409 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: spawned uWSGI worker 2 (pid: 103637, cores: 1) May 16 17:31:01.160409 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 17:31:02.331775 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 17:31:02.341366 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 17:31:03.054375 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 17:31:03.054375 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: from cryptography.utils import int_from_bytes May 16 17:31:03.054756 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 17:31:03.054756 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: from cryptography.utils import int_from_bytes May 16 17:31:03.054891 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 17:31:03.054891 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: from cryptography.utils import int_from_bytes May 16 17:31:03.055018 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 17:31:03.055018 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: from cryptography.utils import int_from_bytes May 16 17:31:05.646262 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 17:31:05.647023 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 17:31:05.647023 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 17:31:05.647413 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 17:31:05.647664 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 17:31:05.648054 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.648385 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.648714 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.649039 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.649375 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.649716 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.650025 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.650349 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.650675 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.650933 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.651248 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.651571 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837699-6-iscsi {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.651667 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 17:31:05.652034 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.652121 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 17:31:05.652203 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.652429 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 17:31:05.652524 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.652787 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.652883 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 17:31:05.653041 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 17:31:05.653133 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.653400 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.653498 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.653728 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.653823 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.654088 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.654227 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.654642 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.654778 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.654888 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.654991 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.655104 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.655282 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.655396 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.655614 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.655757 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.655946 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.656115 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.656293 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.656381 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.656499 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.656587 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.656823 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837699-6-iscsi {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.656977 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.657147 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.657247 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.657459 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.657584 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.657860 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.657960 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837699-6-iscsi {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.658185 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.658289 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.658493 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.658594 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.658817 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.658934 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.659138 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.659253 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.659570 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.659679 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.659886 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.659990 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.660206 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.660319 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.660524 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.660616 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.660831 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.660922 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.661160 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.661256 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.661470 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.661589 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.661818 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.661917 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.662129 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.662213 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.662431 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.662514 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.662740 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.662834 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.663048 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.663134 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837699-6-iscsi {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.663367 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.663460 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.663673 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.663764 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.663979 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.664077 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.664228 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.664443 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.664535 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.664758 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.664853 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.665071 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.665171 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.665394 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.665492 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.665727 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.665815 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.665978 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.666076 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.666300 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.666412 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.666619 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.666717 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.666930 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.667071 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.667239 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.667335 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.667544 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.667636 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.667851 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.667943 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.668158 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.668252 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.668468 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.668558 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.668772 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.668864 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.669074 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.669157 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.669325 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.669416 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.669658 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.669748 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.669984 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.670135 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.670341 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.670507 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.670605 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.670690 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.671209 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.671340 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.671440 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.671612 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.671742 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.671844 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.672093 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.672235 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.672406 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.672538 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.672713 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.672844 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.673019 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.673150 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.673330 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.673471 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.673699 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.673846 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.673976 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.674071 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.674284 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.674429 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.674593 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.674678 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.674911 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.674996 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.675215 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.675308 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.675466 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.675555 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.675779 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.675928 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.676075 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.676161 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.676393 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.676519 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.676702 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.676797 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.677013 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.677167 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.677320 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.677413 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.677642 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.677748 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.677954 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.678081 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.678260 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.678372 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.678571 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.678690 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.678876 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.678987 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.679183 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.679292 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.679488 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.679619 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.679991 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.680146 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.680297 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.680440 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.680591 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.680734 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.680734 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.681236 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.681381 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.681525 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.681720 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.681865 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.682000 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.682135 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.682268 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.682416 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.682562 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.682707 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.682848 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.682994 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.683136 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.683283 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.683435 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.683579 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.683725 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.683873 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.684017 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.684159 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.684316 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.684458 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.684599 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.684737 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.684878 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.684967 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.685105 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.685197 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.685321 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.685454 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.685607 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.685799 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.686007 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.686120 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.686271 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.686405 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.686616 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.686802 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.686946 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.687073 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.687213 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.687366 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.687501 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.687647 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.687781 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.687913 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.687913 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.688180 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.688314 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.688454 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.688592 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.688723 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.688872 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.689004 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.689186 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.689322 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.689462 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.689628 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.689767 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.689912 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.690044 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.690184 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.690321 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.690453 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.690592 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.690734 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.690878 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.691019 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.691204 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.691344 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.691484 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.691635 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.691775 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.691906 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.692119 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.692307 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.692452 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.692598 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.692741 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.692872 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.693001 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.693132 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.693260 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.693404 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.693576 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.693709 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.693839 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.694053 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.694242 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.694396 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.694539 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.694670 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.694810 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.694940 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.695077 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.695223 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.695391 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.695563 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.695700 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:31:05.695906 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.696116 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.696279 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.696426 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.696580 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.696743 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.696892 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.697037 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.697171 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.697323 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.697469 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.697638 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.697775 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.698006 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.698153 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.698287 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.698426 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.698577 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.698710 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.698858 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.698991 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.699124 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.699346 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.699535 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.699679 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.699835 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.699971 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.700104 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.700236 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.700370 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.700539 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.700688 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.700863 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.701011 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.701224 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.701427 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.701595 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.701746 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.701892 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.702026 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.702160 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.702300 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.702434 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.702576 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.702747 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.702896 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.703047 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.703184 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.703341 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.703473 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.703719 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.703919 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.704063 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.704215 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.704357 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.704489 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.704632 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.704759 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.704964 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.705169 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.705323 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.705471 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.705657 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.705790 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.705922 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.706052 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.706193 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.706347 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.706461 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.706553 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.706802 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.706949 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.707110 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.707243 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.707388 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.707479 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.707728 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.707919 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.708013 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.708148 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.708356 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.708502 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.708689 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.708834 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.708967 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.709054 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.709280 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.709363 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.709613 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.709727 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.709935 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.710021 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.710251 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.710346 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.710566 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.710662 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.710882 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.710978 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.711189 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.711281 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.711495 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.711582 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.711800 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.711895 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.712108 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.712191 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.712409 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.712494 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.712727 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.712811 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.713034 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.713126 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.713349 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.713440 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.713688 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.713790 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.714006 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.714104 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.714316 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.714401 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.714628 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.714713 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.714937 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.715034 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.715245 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.715338 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.715559 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.715643 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.715871 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.715968 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.716178 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.716263 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.716507 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.716611 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.716817 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.716959 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.717132 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.717223 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.717447 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.717537 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.717781 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.717874 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.718086 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.718170 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.718393 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.718476 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.718701 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.718786 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.719006 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.719103 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.719316 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.719407 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.719618 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.719709 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.719923 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.720008 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.720261 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.720348 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.720578 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.720666 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.720885 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.720969 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.721210 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.721305 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.721522 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.721636 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.721848 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.721934 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.722155 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.722248 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.722514 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.722609 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.722802 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.722887 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.723107 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.723205 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.723414 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.723499 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.723721 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.723807 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.724029 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.724123 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.724340 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.724432 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.724645 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.724736 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.724950 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.725036 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.725258 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.725349 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.725583 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.725741 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.725889 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.726000 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.726206 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.726297 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.726514 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.726598 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.726818 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.726911 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.727129 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.727217 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.727433 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.727517 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.727761 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.727853 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.728067 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.728159 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.728388 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.728481 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.728699 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.728785 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.729019 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.729111 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.729346 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.729438 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.729695 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.729794 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.730012 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.730105 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.730322 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.730416 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.730633 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.730761 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.730945 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.731040 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.731255 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.731352 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.731572 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.731656 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.731882 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.731978 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.732194 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.732287 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.732502 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.732594 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.732814 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.732898 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.733128 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.733225 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.733440 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.733523 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.733769 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.733855 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.734087 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.734181 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.734405 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.734489 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.734710 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.734801 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.735026 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.735112 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.735354 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.735439 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.735664 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.735747 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.736009 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.736095 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.736323 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.736415 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.736639 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.736732 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.736948 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.737031 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.737262 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.737351 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.737599 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.737700 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.737908 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.737991 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.738215 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.738299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.738524 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.738617 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.738836 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.738921 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.739147 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.739275 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.739461 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.739559 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.739762 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.739852 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.740074 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.740158 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.740385 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.740478 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.740690 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.740816 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.740995 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.741081 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.741308 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.741400 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.741647 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.741733 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.741960 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.742045 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.742272 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.742359 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.742583 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.742668 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.742887 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.742971 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.743191 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.743276 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.743500 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.743591 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.743806 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.743889 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.744111 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.744204 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.744416 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.744500 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.744720 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.744862 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.745034 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.745121 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.745342 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.745427 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.745670 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.745770 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.745974 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.746059 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.746285 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.746369 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.746599 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.746725 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.746909 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.746993 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.747219 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.747321 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.747534 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.747629 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.747835 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.747918 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.748137 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.748229 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.748450 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.748541 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.748754 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.748837 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.749059 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.749143 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.749364 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.749452 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.749692 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.749779 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.750015 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.750098 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.750325 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.750412 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.750624 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.750707 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.750937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.751021 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.751239 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.751325 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.751608 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.751703 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.751914 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.752010 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.752222 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.752486 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.752579 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.752827 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.752971 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.753135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.753221 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.753442 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.753528 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.753780 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.753867 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.754092 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.754179 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.754403 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.754488 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.754713 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.754798 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.755039 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.755198 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.755345 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.755442 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.755653 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.755737 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.755960 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.756054 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.756260 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.756344 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.756568 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.756652 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.756874 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.756967 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.757184 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.757444 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.757529 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.757810 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.757907 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.758116 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.758200 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.758420 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.758504 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.758724 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.758818 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.759030 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.759123 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.759346 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.759431 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.759654 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.759748 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.759968 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.760052 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.760275 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.760369 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.760592 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.760676 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.760898 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.761020 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.761201 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.761287 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.761506 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.761660 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.761834 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.761927 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.762136 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.762220 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.762440 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.762544 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.762751 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.762836 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.763054 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.763138 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.763358 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.763455 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.763661 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.763746 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.763968 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.764052 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.764287 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.764381 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.764594 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.764678 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.764906 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.764992 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.765208 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.765300 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.765521 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.765674 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.765856 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.765942 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.766160 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.766253 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.766467 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.766552 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.766772 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.766858 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.767113 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.767209 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.767432 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.767518 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.767738 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.767822 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.768051 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.768136 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.768359 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.768444 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.768679 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.768764 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.768991 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.769076 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.769296 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.769381 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.769625 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.769726 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.769935 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.770026 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.770239 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.770332 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.770540 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.770633 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.770850 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.770941 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.771152 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.771245 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.771463 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.771555 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.771766 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.771850 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.772071 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.772159 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.772375 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.772467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.772679 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.772765 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.772986 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.773070 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.773286 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.773372 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.773635 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.773723 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.773950 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.774034 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.774254 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.774340 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.774558 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.774643 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.774868 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.774960 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.775172 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.775300 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.775472 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.775557 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.775778 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.775861 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.776081 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.776166 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.776397 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.776481 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.776698 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.776794 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.777003 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.777095 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.777305 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.777388 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.777634 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.777735 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.777940 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.778030 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.778239 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.778324 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.778538 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.778630 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.778839 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.778923 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.779140 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.779224 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.779441 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.779539 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.779742 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.779827 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.780044 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.780129 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.780348 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.780434 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.780647 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.780730 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.780951 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.781044 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.781254 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.781340 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.781564 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.781651 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.781888 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.781972 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.782193 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.782283 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.782496 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.782580 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.782871 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.782960 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.783179 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.783266 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.783479 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.783564 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.783779 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.783874 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.784080 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.784165 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.784381 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.784473 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.784681 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.784779 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.784994 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.785120 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.785430 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.785580 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.785691 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.785808 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.785923 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.786036 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.786404 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.786537 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.786643 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.786756 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.786862 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.786965 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.787319 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.787451 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.787567 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.787672 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.787775 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.787877 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.788047 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.788159 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.788358 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.788471 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.788671 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.788781 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.788978 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.789089 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.789279 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.789390 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.789604 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.789718 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.789915 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.790038 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.790223 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.790341 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.790524 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.790642 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.790826 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.790922 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.791135 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.791220 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.791444 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.791540 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.791750 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.791844 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.792055 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.792135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.792358 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.792452 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.792680 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.792777 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.792980 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.793067 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.793281 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.793364 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.793608 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.793715 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.793914 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.794000 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.794220 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.794312 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.794520 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.794613 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.794829 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.794951 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.795140 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.795295 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.795460 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.795595 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.795794 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.796234 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.796417 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.796549 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.796708 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.796801 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.797018 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.797115 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.797328 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.797433 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.797666 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.797770 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.797988 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.798148 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.798295 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.798486 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.798612 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.798801 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.798943 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.799100 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.799224 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.799406 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.799536 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.799708 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.799839 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.800019 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.800265 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.800361 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.800576 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.800668 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.800885 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.800970 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.801188 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.801281 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.801500 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.801618 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.801832 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.801916 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.802146 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.802322 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.802465 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.802626 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.802771 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.802907 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.803154 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.803285 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.803487 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.803625 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.803799 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.803930 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.804108 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.804240 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.804411 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.804541 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.804710 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.804843 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.805017 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.805148 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.805337 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.805489 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.805690 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.805821 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.805963 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.806096 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.806236 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.806383 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.806547 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.806686 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.806851 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.806981 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.807175 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.807307 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.807517 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.807683 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.807838 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.807986 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.808163 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.808250 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.808475 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.808560 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.808794 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.808894 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.809166 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.809270 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.809489 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.809615 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.809834 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.809933 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.810154 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.810249 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.810455 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.810548 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.810768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.810864 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.811069 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.811152 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.811380 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.811465 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.811689 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.811782 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.811993 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.812076 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.812307 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.812392 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.812609 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.812705 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.812922 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.813013 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.813234 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.813318 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.813573 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.813676 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.813877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.813959 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.814234 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.814344 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.814560 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.814669 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.814866 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.814979 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.815189 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.815283 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.815503 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.815615 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.815825 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.815909 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.816152 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.816244 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.816457 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.816547 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.816786 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.816871 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.817092 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.817183 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.817396 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.817493 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.817728 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.817837 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.818032 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.818126 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.818340 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.818430 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.818650 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.818735 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.818954 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.819046 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.819262 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.819346 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.819583 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.819680 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.819887 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.819973 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.820210 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.820302 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.820522 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.820607 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.820843 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.820926 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.821161 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.821244 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.821463 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.821591 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.821802 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.821893 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.822102 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.822195 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.822405 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.822496 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.822710 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.822800 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.823011 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.823103 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.823310 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.823402 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.823619 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.823715 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.823920 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.824004 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.824222 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.824314 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.824525 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.824617 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.824847 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.824937 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.825154 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.825239 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.825477 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.825583 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.825812 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.825908 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.826118 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.826203 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.826422 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.826507 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.826730 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.826821 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.827045 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.827140 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.827355 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.827441 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.827661 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.827806 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.827964 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.828056 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.828268 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.828360 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.828576 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.828669 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.828878 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.828969 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.829177 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.829269 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.829480 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.829624 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.829854 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.829946 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.830158 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.830242 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.830478 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.830570 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.830786 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.830868 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.831089 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.831179 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.831393 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.831486 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.831695 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.831825 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.832013 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.832096 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.832327 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.832419 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.832643 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.832727 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.832962 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.833171 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.833271 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.833506 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.833635 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.833849 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.833934 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.834166 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.834260 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.834483 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.834568 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.834801 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.834885 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.835119 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.835212 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.835434 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.835518 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.835749 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.835833 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.836064 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.836149 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.836378 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.836463 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.836689 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.836773 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.837017 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.837103 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.837333 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.837425 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.837677 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.837767 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.837999 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.838206 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.838317 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.838541 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.838632 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.838860 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.838946 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.839175 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.839289 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.839494 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.839631 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.839811 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.839899 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.840127 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.840218 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.840439 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.840523 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.840755 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.840840 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.841068 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.841152 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.841382 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.841559 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.841719 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.841815 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.842035 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.842122 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.842347 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.842445 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.842661 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.842746 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.842974 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.843066 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.843289 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.843386 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.843601 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.843690 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.843918 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.844009 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.844238 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.844322 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.844552 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.844635 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.844865 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.844955 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.845177 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.845318 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.845537 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.845765 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.845874 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.846083 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.846190 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.846420 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.846504 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.846755 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.846847 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.847081 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.847168 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.847404 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.847496 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.847711 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.847801 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.848022 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.848107 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.848333 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.848418 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.848638 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.848721 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.848950 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.849043 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.849261 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.849345 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.849578 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.849724 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.849905 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.849988 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.850213 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.850295 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.850517 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.850730 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.850835 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.851046 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.851131 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.851382 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.851664 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.851757 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.852014 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.852098 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.852328 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.852418 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.852646 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.852731 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.852967 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.853058 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.853269 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.853363 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.853595 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.853725 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.853921 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.854035 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.854227 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.854322 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.854529 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.854625 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.854844 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.854945 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.855150 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.855260 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.855454 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.855549 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.855759 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.855855 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.856066 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.856173 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.856374 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.856598 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.856694 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.856953 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.857056 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.857264 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.857364 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.857608 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.857705 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.857916 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.858027 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.858223 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.858326 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.858527 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.858621 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.858840 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.858934 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.859141 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.859234 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.859443 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.859535 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.859748 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.859863 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.860053 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.860136 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.860355 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.860439 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.860656 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.860747 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.860988 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.861074 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.861290 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.861380 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.861609 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.861712 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.861920 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.862005 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.862222 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.862309 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.862549 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.862646 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.862855 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.862940 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.863158 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.863277 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.863459 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.863544 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.863767 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.863857 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.864071 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.864162 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.864374 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.864465 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.864677 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.864762 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.864983 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.865076 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.865293 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.865385 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.865617 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.865718 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.865929 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.866179 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.866273 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.866522 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.866607 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.866824 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.866906 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.867140 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.867226 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.867480 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.867562 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.867785 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.867869 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.868091 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.868229 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.868393 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.868478 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.868708 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.868793 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.869020 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.869111 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.869331 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.869416 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.869665 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.869753 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.869975 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.870062 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.870285 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.870370 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.870595 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.870754 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.870907 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.871137 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.871228 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.871473 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.871557 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.871794 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.871891 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.872108 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.872226 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.872416 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.872503 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.872730 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.872816 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.873031 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.873115 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.873338 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.873434 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.873688 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.873780 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.873998 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.874083 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.874307 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.874401 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.874617 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.874707 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.874925 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.875008 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.875233 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.875325 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.875541 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.875623 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.875848 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.875931 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.876158 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.876251 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.876536 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.876638 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.876842 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.876933 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.877156 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.877262 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.877462 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.877595 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.877803 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.877921 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.878145 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.878232 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.878468 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.878556 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.878786 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.878872 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.879104 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.879189 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.879421 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.879505 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.879731 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.879824 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.880041 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.880125 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.880352 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.880437 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.880681 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.880783 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.880998 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.881082 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.881325 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.881411 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.881658 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.881761 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.881961 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.882043 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.882264 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.882377 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.882576 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.882694 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.882896 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.883014 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.883207 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.883337 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.883511 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.883646 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.883815 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.883966 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.884126 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.884287 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.884430 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.884599 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.884733 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.884919 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.885039 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.885231 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.885344 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.885587 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.885687 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.885919 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.886011 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.886246 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.886331 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.886553 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.886636 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.886856 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.886949 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.887159 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.887243 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.887461 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.887551 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.887766 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.887858 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.888069 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.888153 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.888376 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.888467 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.888675 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.888766 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.888975 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.889059 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.889274 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.889355 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.889594 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.889692 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.889899 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.889983 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.890203 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.890304 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.890503 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.890845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.891147 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.891266 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.891369 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.891480 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.891583 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.891695 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.891797 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.891899 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.892000 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.892134 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.892572 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.892698 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.892803 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.892905 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.893007 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.893243 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.893364 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.893585 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.893699 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.893905 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.894023 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.894210 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.894327 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.894511 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.894621 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.894822 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.894988 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.895133 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.895325 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.895449 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.895640 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.895770 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.895960 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.896083 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.896310 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.896405 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.896593 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.896715 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.896904 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.897039 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.897223 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.897358 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.897541 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.897695 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.897879 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.898033 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.898189 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.898347 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.898533 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.898660 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.898843 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.898979 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.899153 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.899293 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.899464 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.899609 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.899759 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.899931 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.900068 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.900250 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.900374 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.900578 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.900701 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.900906 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.901025 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.901219 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.901329 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.901602 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.901693 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.901898 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.901984 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.902245 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.902330 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.902564 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.902660 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.902893 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.902977 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.903224 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.903319 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.903534 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.903619 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.903842 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.903927 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.904144 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.904226 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.904388 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 17:31:05.904480 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.904753 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.905069 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.905383 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.905741 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.906069 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.906377 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.906702 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.907034 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.907376 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.907703 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.908074 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.908402 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.908716 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.909029 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.909331 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:31:05.909607 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 17:31:05.928441 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_db.sqlalchemy.engines [None req-78ca5088-8323-430c-8eb6-b2ffd4399112 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 17:31:05.932508 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG oslo_db.sqlalchemy.engines [None req-3fd87d9a-1796-49c8-8c13-9ab25fd54f58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 17:31:05.991705 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.context [None req-78ca5088-8323-430c-8eb6-b2ffd4399112 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e1c4446-23c6-4b82-8040-1fc724b16042(cell1) {{(pid=103637) load_cells /opt/stack/nova/nova/context.py:464}} May 16 17:31:05.996082 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-78ca5088-8323-430c-8eb6-b2ffd4399112 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:05.997094 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.context [None req-3fd87d9a-1796-49c8-8c13-9ab25fd54f58 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e1c4446-23c6-4b82-8040-1fc724b16042(cell1) {{(pid=103636) load_cells /opt/stack/nova/nova/context.py:464}} May 16 17:31:05.997658 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-78ca5088-8323-430c-8eb6-b2ffd4399112 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:05.998456 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-78ca5088-8323-430c-8eb6-b2ffd4399112 None None] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:06.000655 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-78ca5088-8323-430c-8eb6-b2ffd4399112 None None] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:06.001402 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG oslo_concurrency.lockutils [None req-3fd87d9a-1796-49c8-8c13-9ab25fd54f58 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:06.003290 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG oslo_concurrency.lockutils [None req-3fd87d9a-1796-49c8-8c13-9ab25fd54f58 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:06.004071 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG oslo_concurrency.lockutils [None req-3fd87d9a-1796-49c8-8c13-9ab25fd54f58 None None] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:31:06.006094 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG oslo_concurrency.lockutils [None req-3fd87d9a-1796-49c8-8c13-9ab25fd54f58 None None] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:31:06.012114 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_db.sqlalchemy.engines [None req-78ca5088-8323-430c-8eb6-b2ffd4399112 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 17:31:06.015871 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_db.sqlalchemy.engines [None req-78ca5088-8323-430c-8eb6-b2ffd4399112 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 17:31:06.019961 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG oslo_db.sqlalchemy.engines [None req-3fd87d9a-1796-49c8-8c13-9ab25fd54f58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 17:31:06.023611 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG oslo_db.sqlalchemy.engines [None req-3fd87d9a-1796-49c8-8c13-9ab25fd54f58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 17:31:06.182646 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_db.sqlalchemy.engines [None req-78ca5088-8323-430c-8eb6-b2ffd4399112 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 17:31:06.185987 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG oslo_db.sqlalchemy.engines [None req-3fd87d9a-1796-49c8-8c13-9ab25fd54f58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 17:31:06.516954 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: WARNING keystonemiddleware.auth_token [None req-3fd87d9a-1796-49c8-8c13-9ab25fd54f58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 17:31:06.518204 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: WARNING keystonemiddleware.auth_token [None req-78ca5088-8323-430c-8eb6-b2ffd4399112 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 17:31:06.524382 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: WARNING keystonemiddleware.auth_token [None req-3fd87d9a-1796-49c8-8c13-9ab25fd54f58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 17:31:06.525580 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: WARNING keystonemiddleware.auth_token [None req-78ca5088-8323-430c-8eb6-b2ffd4399112 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 17:31:06.867521 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: WARNING keystonemiddleware.auth_token [None req-3fd87d9a-1796-49c8-8c13-9ab25fd54f58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 17:31:06.868037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: WARNING keystonemiddleware.auth_token [None req-78ca5088-8323-430c-8eb6-b2ffd4399112 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 17:31:06.873644 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: WARNING keystonemiddleware.auth_token [None req-3fd87d9a-1796-49c8-8c13-9ab25fd54f58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 17:31:06.873999 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: WARNING keystonemiddleware.auth_token [None req-78ca5088-8323-430c-8eb6-b2ffd4399112 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 17:31:06.879827 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5619671999c0 pid: 103636 (default app) May 16 17:31:06.880154 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5619671999c0 pid: 103637 (default app) May 16 17:31:06.882030 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-3fd87d9a-1796-49c8-8c13-9ab25fd54f58 None None] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:31:06.883231 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-3fd87d9a-1796-49c8-8c13-9ab25fd54f58 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001908 May 16 17:31:06.883640 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Mon May 16 17:31:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:32:24.737842 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-78ca5088-8323-430c-8eb6-b2ffd4399112 None None] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:32:24.739323 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-78ca5088-8323-430c-8eb6-b2ffd4399112 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002303 May 16 17:32:24.740030 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 930 bytes} [Mon May 16 17:32:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:32:25.164016 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-b366b230-4364-455d-b6d2-e340b8f18b43 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:32:25.193830 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-b366b230-4364-455d-b6d2-e340b8f18b43 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.447494 May 16 17:32:25.194661 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 2/3] 10.222.0.58 () {60 vars in 1291 bytes} [Mon May 16 17:32:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:32:27.454551 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-78ca5088-8323-430c-8eb6-b2ffd4399112 None None] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:32:27.456255 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-78ca5088-8323-430c-8eb6-b2ffd4399112 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002111 May 16 17:32:27.456654 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 2/4] 10.222.0.58 () {54 vars in 930 bytes} [Mon May 16 17:32:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:32:27.522930 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-d963ac8b-ba68-4623-9253-abc36381d9a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "c1", "swap": 0, "disk": 1, "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:27.543297 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 17:32:27.543297 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: warnings.warn(msg) May 16 17:32:27.574084 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-d963ac8b-ba68-4623-9253-abc36381d9a2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.111425 May 16 17:32:27.574615 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 3/5] 10.222.0.58 () {64 vars in 1282 bytes} [Mon May 16 17:32:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:32:27.793266 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-04a86375-0d13-4ac9-9b73-7d3d7aad793a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:27.796318 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 17:32:27.796318 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: warnings.warn(msg) May 16 17:32:27.846053 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-04a86375-0d13-4ac9-9b73-7d3d7aad793a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262820 May 16 17:32:27.850427 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 3/6] 10.222.0.58 () {64 vars in 1335 bytes} [Mon May 16 17:32:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:32:30.133731 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-d963ac8b-ba68-4623-9253-abc36381d9a2 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:32:30.134765 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-d963ac8b-ba68-4623-9253-abc36381d9a2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 May 16 17:32:30.135156 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 4/7] 10.222.0.58 () {54 vars in 930 bytes} [Mon May 16 17:32:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:32:30.248123 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-3520fe56-8643-4d6e-bdba-37f28ebce502 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:30.265899 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 17:32:30.265899 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: warnings.warn(msg) May 16 17:32:30.284907 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-3520fe56-8643-4d6e-bdba-37f28ebce502 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143946 May 16 17:32:30.285489 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 4/8] 10.222.0.58 () {64 vars in 1282 bytes} [Mon May 16 17:32:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:32:30.297927 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-a611bc1e-c3c4-4e3b-b854-729b172b9b54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:30.299498 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 17:32:30.299498 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: warnings.warn(msg) May 16 17:32:30.335110 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-a611bc1e-c3c4-4e3b-b854-729b172b9b54 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041381 May 16 17:32:30.335802 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 5/9] 10.222.0.58 () {64 vars in 1335 bytes} [Mon May 16 17:32:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:32:32.563863 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-3520fe56-8643-4d6e-bdba-37f28ebce502 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:32:32.564841 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-3520fe56-8643-4d6e-bdba-37f28ebce502 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 16 17:32:32.565456 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 930 bytes} [Mon May 16 17:32:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:32:32.628528 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-87737b29-c3eb-4edc-b986-260de4ac6653 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d2", "disk": 10, "vcpus": 1, "ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:32.647675 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-87737b29-c3eb-4edc-b986-260de4ac6653 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076387 May 16 17:32:32.653624 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 6/11] 10.222.0.58 () {64 vars in 1282 bytes} [Mon May 16 17:32:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:32:32.660889 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-1d02aa89-3e05-450f-accb-97ae745273bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:32.687466 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-1d02aa89-3e05-450f-accb-97ae745273bf admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030263 May 16 17:32:32.688312 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 6/12] 10.222.0.58 () {64 vars in 1335 bytes} [Mon May 16 17:32:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:32:34.937901 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-87737b29-c3eb-4edc-b986-260de4ac6653 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:32:34.938841 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-87737b29-c3eb-4edc-b986-260de4ac6653 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 May 16 17:32:34.939460 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 7/13] 10.222.0.58 () {54 vars in 930 bytes} [Mon May 16 17:32:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:32:35.001616 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-69be4f02-67ba-4564-a25b-3f09ed28c995 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:35.021368 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-69be4f02-67ba-4564-a25b-3f09ed28c995 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075706 May 16 17:32:35.021986 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 7/14] 10.222.0.58 () {64 vars in 1282 bytes} [Mon May 16 17:32:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:32:35.034329 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-32acad91-6cc2-491b-b0e2-3ca26bb5ddf9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:35.058862 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-32acad91-6cc2-491b-b0e2-3ca26bb5ddf9 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028425 May 16 17:32:35.059614 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 8/15] 10.222.0.58 () {64 vars in 1335 bytes} [Mon May 16 17:32:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:32:37.325089 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-69be4f02-67ba-4564-a25b-3f09ed28c995 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:32:37.326155 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-69be4f02-67ba-4564-a25b-3f09ed28c995 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 May 16 17:32:37.327149 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 8/16] 10.222.0.58 () {54 vars in 930 bytes} [Mon May 16 17:32:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:32:37.387169 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-31feaef3-13a8-4610-a410-5caa58ea9c27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:37.406563 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-31feaef3-13a8-4610-a410-5caa58ea9c27 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073295 May 16 17:32:37.407221 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 9/17] 10.222.0.58 () {64 vars in 1282 bytes} [Mon May 16 17:32:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:32:37.419488 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-3fe3b358-5ce2-4c8b-8558-643f1a34175d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:37.443678 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-3fe3b358-5ce2-4c8b-8558-643f1a34175d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028261 May 16 17:32:37.444521 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 9/18] 10.222.0.58 () {64 vars in 1335 bytes} [Mon May 16 17:32:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:32:39.692252 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-31feaef3-13a8-4610-a410-5caa58ea9c27 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:32:39.693256 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-31feaef3-13a8-4610-a410-5caa58ea9c27 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 May 16 17:32:39.694211 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 10/19] 10.222.0.58 () {54 vars in 930 bytes} [Mon May 16 17:32:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:32:39.756469 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-95d946f4-cc89-4a94-a074-b346b7ea89ea admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:32:39.780719 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-95d946f4-cc89-4a94-a074-b346b7ea89ea admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079503 May 16 17:32:39.781527 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 10/20] 10.222.0.58 () {60 vars in 1291 bytes} [Mon May 16 17:32:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:32:42.029300 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-31feaef3-13a8-4610-a410-5caa58ea9c27 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:32:42.030347 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-31feaef3-13a8-4610-a410-5caa58ea9c27 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 16 17:32:42.030751 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 11/21] 10.222.0.58 () {54 vars in 930 bytes} [Mon May 16 17:32:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:32:42.091322 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-83a898f8-6018-4758-a02d-b789f75234a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "id": "1", "ram": 512, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:42.112354 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-83a898f8-6018-4758-a02d-b789f75234a7 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075677 May 16 17:32:42.113076 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 11/22] 10.222.0.58 () {64 vars in 1282 bytes} [Mon May 16 17:32:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:32:42.124947 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-3129553d-9137-4ce5-9681-e871d35f8e05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:42.147313 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-3129553d-9137-4ce5-9681-e871d35f8e05 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026138 May 16 17:32:42.148090 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 12/23] 10.222.0.58 () {64 vars in 1332 bytes} [Mon May 16 17:32:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:32:44.364718 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-83a898f8-6018-4758-a02d-b789f75234a7 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:32:44.366091 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-83a898f8-6018-4758-a02d-b789f75234a7 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001927 May 16 17:32:44.366585 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 12/24] 10.222.0.58 () {54 vars in 930 bytes} [Mon May 16 17:32:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:32:44.424808 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-4670487d-5add-483c-b00a-b1ca92ce9f2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "id": "2", "name": "m1.small", "ram": 2048, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:44.446228 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-4670487d-5add-483c-b00a-b1ca92ce9f2a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073697 May 16 17:32:44.446981 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 13/25] 10.222.0.58 () {64 vars in 1282 bytes} [Mon May 16 17:32:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:32:44.458915 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-e5149094-9c90-4ada-bee7-45eea9aa632d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:44.480669 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-e5149094-9c90-4ada-bee7-45eea9aa632d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025548 May 16 17:32:44.481223 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 13/26] 10.222.0.58 () {64 vars in 1332 bytes} [Mon May 16 17:32:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:32:46.790747 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-4670487d-5add-483c-b00a-b1ca92ce9f2a admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:32:46.791746 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-4670487d-5add-483c-b00a-b1ca92ce9f2a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 16 17:32:46.792149 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 14/27] 10.222.0.58 () {54 vars in 930 bytes} [Mon May 16 17:32:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:32:46.853649 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-998bec88-de9a-4341-870b-06aef6cf0de0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "disk": 40, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "os-flavor-access:is_public": true}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:46.871905 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-998bec88-de9a-4341-870b-06aef6cf0de0 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073352 May 16 17:32:46.872485 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 14/28] 10.222.0.58 () {64 vars in 1282 bytes} [Mon May 16 17:32:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:32:46.884231 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-d0cc5e73-57da-4822-a2f3-2b732b083a83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:46.906433 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-d0cc5e73-57da-4822-a2f3-2b732b083a83 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025816 May 16 17:32:46.907040 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 15/29] 10.222.0.58 () {64 vars in 1332 bytes} [Mon May 16 17:32:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:32:49.123520 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-998bec88-de9a-4341-870b-06aef6cf0de0 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:32:49.125271 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-998bec88-de9a-4341-870b-06aef6cf0de0 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002188 May 16 17:32:49.136098 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 15/30] 10.222.0.58 () {54 vars in 930 bytes} [Mon May 16 17:32:49 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:32:49.198205 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-46b2c52b-4548-4158-a52a-53f5d374c7b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "id": "4", "rxtx_factor": 1.0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:49.219659 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-46b2c52b-4548-4158-a52a-53f5d374c7b9 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.087644 May 16 17:32:49.220470 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 16/31] 10.222.0.58 () {64 vars in 1282 bytes} [Mon May 16 17:32:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:32:49.232415 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-06a64f2b-f762-4ef3-973e-caab934d049a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:49.255089 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-06a64f2b-f762-4ef3-973e-caab934d049a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026568 May 16 17:32:49.255847 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 16/32] 10.222.0.58 () {64 vars in 1332 bytes} [Mon May 16 17:32:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:32:51.497562 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-46b2c52b-4548-4158-a52a-53f5d374c7b9 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:32:51.499292 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-46b2c52b-4548-4158-a52a-53f5d374c7b9 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002199 May 16 17:32:51.501955 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 17/33] 10.222.0.58 () {54 vars in 930 bytes} [Mon May 16 17:32:51 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:32:51.564085 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-23cd9ab8-2eb2-434f-81cc-6f0052785236 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "ram": 16384, "rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge", "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:51.588089 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-23cd9ab8-2eb2-434f-81cc-6f0052785236 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.082194 May 16 17:32:51.589326 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 17/34] 10.222.0.58 () {64 vars in 1282 bytes} [Mon May 16 17:32:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:32:51.601775 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-f8e5ce67-da5e-45f4-a0e3-ee5c51010bf2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:32:51.631907 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-f8e5ce67-da5e-45f4-a0e3-ee5c51010bf2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034052 May 16 17:32:51.632501 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 18/35] 10.222.0.58 () {64 vars in 1332 bytes} [Mon May 16 17:32:51 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:33:15.851554 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-23cd9ab8-2eb2-434f-81cc-6f0052785236 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:15.853124 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-23cd9ab8-2eb2-434f-81cc-6f0052785236 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002195 May 16 17:33:15.853749 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 18/36] 10.222.0.58 () {54 vars in 930 bytes} [Mon May 16 17:33:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:33:15.910358 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-ad4af28b-d63b-4007-a56e-de4b811c75b4 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:15.929506 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-ad4af28b-d63b-4007-a56e-de4b811c75b4 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069439 May 16 17:33:15.930063 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 19/37] 10.222.0.58 () {60 vars in 1291 bytes} [Mon May 16 17:33:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:33:16.961708 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-23cd9ab8-2eb2-434f-81cc-6f0052785236 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:16.962718 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-23cd9ab8-2eb2-434f-81cc-6f0052785236 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 16 17:33:16.963128 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 19/38] 10.222.0.58 () {56 vars in 1074 bytes} [Mon May 16 17:33:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:33:17.173988 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-93e9207a-14dc-4365-9902-694e5b0b898d admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:17.179682 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.wsgi [None req-93e9207a-14dc-4365-9902-694e5b0b898d admin admin] HTTP exception thrown: Flavor 42 could not be found. May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-93e9207a-14dc-4365-9902-694e5b0b898d admin admin] Request method failure captured: May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Accept: application/json May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Accept-Encoding: gzip, deflate May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Connection: keep-alive May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Content-Length: 0 May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Host: 10.222.0.58 May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Openstack-Api-Version: compute 2.90 May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Openstack-System-Scope: None May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: User-Agent: python-novaclient May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Auth-Token: gAAAAABigorc4TtvC13qck2Xma2ZW9F1HzswGL0K8jZIiIiKPKjULpUTPYiJ6Of9NPgYcYtTq1ExmHb-F-vT-TFl100nZvIywIJH_RnFOxshqSDZMMQJkNEibrrjzBmOgXPGSK_jr8wck7768eYi6PGf7pNwi3dOD1-yF6TxSsERPXanPYyq9CU May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Domain-Id: None May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Domain-Name: None May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Identity-Status: Confirmed May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Is-Admin-Project: True May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Openstack-Nova-Api-Version: 2.90 May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Project-Domain-Id: default May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Project-Domain-Name: Default May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Project-Id: ab7c1a113cb54758aa563ff3298e430c May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Project-Name: admin May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Role: admin,reader,member May 16 17:33:17.183033 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Roles: admin,reader,member May 16 17:33:17.184726 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab7c1a113cb54758aa563ff3298e430c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ab7c1a113cb54758aa563ff3298e430c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ab7c1a113cb54758aa563ff3298e430c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab7c1a113cb54758aa563ff3298e430c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:33:17.184726 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Tenant: admin May 16 17:33:17.184726 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Tenant-Id: ab7c1a113cb54758aa563ff3298e430c May 16 17:33:17.184726 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Tenant-Name: admin May 16 17:33:17.184726 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-User: admin May 16 17:33:17.184726 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-User-Domain-Id: default May 16 17:33:17.184726 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-User-Domain-Name: Default May 16 17:33:17.184726 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-User-Id: 4463e4c93e664f46a81171f07eadb93c May 16 17:33:17.184726 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-User-Name: admin May 16 17:33:17.184726 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: method: > May 16 17:33:17.184726 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: exception: Flavor 42 could not be found. May 16 17:33:17.184726 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: action_args: {'id': '42'} May 16 17:33:17.184726 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:33:17.184726 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:33:17.185768 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:33:17.187299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:33:17.187299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:33:17.187299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:33:17.187299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:33:17.187299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 17:33:17.187299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 17:33:17.187299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 16 17:33:17.187299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi May 16 17:33:17.187299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:33:17.187299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi May 16 17:33:17.187299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:33:17.187299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:33:17.187299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:33:17.187299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:33:17.187299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:33:17.187299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 16 17:33:17.187299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi May 16 17:33:17.187299 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-93e9207a-14dc-4365-9902-694e5b0b898d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:33:17.188569 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-93e9207a-14dc-4365-9902-694e5b0b898d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.076309 May 16 17:33:17.188569 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 20/39] 10.222.0.58 () {60 vars in 1190 bytes} [Mon May 16 17:33:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 17:33:17.194433 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-8d868f72-53d2-4b18-9426-91cbbe37c163 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:17.216891 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-8d868f72-53d2-4b18-9426-91cbbe37c163 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026036 May 16 17:33:17.217469 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 20/40] 10.222.0.58 () {60 vars in 1210 bytes} [Mon May 16 17:33:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:33:17.238566 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-6fc4c9cd-4ad2-4dd5-871a-cf75e8f5989a admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:17.259948 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-6fc4c9cd-4ad2-4dd5-871a-cf75e8f5989a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025013 May 16 17:33:17.260486 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 21/41] 10.222.0.58 () {60 vars in 1210 bytes} [Mon May 16 17:33:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:33:17.269882 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-3709223e-120d-4617-9b78-8274d828f107 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:17.275995 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.wsgi [None req-3709223e-120d-4617-9b78-8274d828f107 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-3709223e-120d-4617-9b78-8274d828f107 admin admin] Request method failure captured: May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Accept: application/json May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Accept-Encoding: gzip, deflate May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Connection: keep-alive May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Content-Length: 0 May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Host: 10.222.0.58 May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Openstack-Api-Version: compute 2.90 May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Openstack-System-Scope: None May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: User-Agent: python-novaclient May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Auth-Token: gAAAAABigorc4TtvC13qck2Xma2ZW9F1HzswGL0K8jZIiIiKPKjULpUTPYiJ6Of9NPgYcYtTq1ExmHb-F-vT-TFl100nZvIywIJH_RnFOxshqSDZMMQJkNEibrrjzBmOgXPGSK_jr8wck7768eYi6PGf7pNwi3dOD1-yF6TxSsERPXanPYyq9CU May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Domain-Id: None May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Domain-Name: None May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Identity-Status: Confirmed May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Is-Admin-Project: True May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Openstack-Nova-Api-Version: 2.90 May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Project-Domain-Id: default May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Project-Domain-Name: Default May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Project-Id: ab7c1a113cb54758aa563ff3298e430c May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Project-Name: admin May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Role: admin,reader,member May 16 17:33:17.279294 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Roles: admin,reader,member May 16 17:33:17.280823 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab7c1a113cb54758aa563ff3298e430c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ab7c1a113cb54758aa563ff3298e430c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ab7c1a113cb54758aa563ff3298e430c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab7c1a113cb54758aa563ff3298e430c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:33:17.280823 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Tenant: admin May 16 17:33:17.280823 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Tenant-Id: ab7c1a113cb54758aa563ff3298e430c May 16 17:33:17.280823 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Tenant-Name: admin May 16 17:33:17.280823 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-User: admin May 16 17:33:17.280823 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-User-Domain-Id: default May 16 17:33:17.280823 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-User-Domain-Name: Default May 16 17:33:17.280823 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-User-Id: 4463e4c93e664f46a81171f07eadb93c May 16 17:33:17.280823 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-User-Name: admin May 16 17:33:17.280823 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: method: > May 16 17:33:17.280823 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: exception: Flavor 42 could not be found. May 16 17:33:17.280823 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: action_args: {'id': '42'} May 16 17:33:17.280823 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:33:17.280823 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:33:17.281877 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:33:17.283182 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:33:17.283182 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:33:17.283182 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:33:17.283182 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:33:17.283182 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 17:33:17.283182 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 17:33:17.283182 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 16 17:33:17.283182 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi May 16 17:33:17.283182 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:33:17.283182 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi May 16 17:33:17.283182 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:33:17.283182 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:33:17.283182 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:33:17.283182 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:33:17.283182 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:33:17.283182 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 16 17:33:17.283182 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi May 16 17:33:17.283182 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-3709223e-120d-4617-9b78-8274d828f107 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:33:17.284436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-3709223e-120d-4617-9b78-8274d828f107 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014374 May 16 17:33:17.284793 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 21/42] 10.222.0.58 () {60 vars in 1190 bytes} [Mon May 16 17:33:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 17:33:18.173925 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-6fc4c9cd-4ad2-4dd5-871a-cf75e8f5989a admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:18.175523 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-6fc4c9cd-4ad2-4dd5-871a-cf75e8f5989a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002254 May 16 17:33:18.176441 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 22/43] 10.222.0.58 () {56 vars in 1074 bytes} [Mon May 16 17:33:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:33:18.375626 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-c6ceccbc-58a8-4d5e-900f-4e2881e59a25 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:18.380945 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.wsgi [None req-c6ceccbc-58a8-4d5e-900f-4e2881e59a25 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-c6ceccbc-58a8-4d5e-900f-4e2881e59a25 admin admin] Request method failure captured: May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Accept: application/json May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Accept-Encoding: gzip, deflate May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Connection: keep-alive May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Content-Length: 0 May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Host: 10.222.0.58 May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Openstack-Api-Version: compute 2.90 May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Openstack-System-Scope: None May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: User-Agent: python-novaclient May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Auth-Token: gAAAAABigoresPMEWWxUqagfh-GCOpznP2mTRodOCXVTLWHUc_1L57exwVQ0tDv3h_GVwyywo1-4pRadZSDlwwejVykv8Ibdrf1dSUjJ7WwNZcI1G9VoL3WA9GnUm1zOAm9kqkIiPC55hphP2pTC_TozsR2noLTZT4ARohQX7BGCh8LbgIiUNW8 May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Domain-Id: None May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Domain-Name: None May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Identity-Status: Confirmed May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Is-Admin-Project: True May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Openstack-Nova-Api-Version: 2.90 May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Project-Domain-Id: default May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Project-Domain-Name: Default May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Project-Id: ab7c1a113cb54758aa563ff3298e430c May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Project-Name: admin May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Role: admin,reader,member May 16 17:33:18.382467 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Roles: admin,reader,member May 16 17:33:18.383967 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab7c1a113cb54758aa563ff3298e430c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ab7c1a113cb54758aa563ff3298e430c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ab7c1a113cb54758aa563ff3298e430c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab7c1a113cb54758aa563ff3298e430c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:33:18.383967 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Tenant: admin May 16 17:33:18.383967 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Tenant-Id: ab7c1a113cb54758aa563ff3298e430c May 16 17:33:18.383967 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Tenant-Name: admin May 16 17:33:18.383967 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-User: admin May 16 17:33:18.383967 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-User-Domain-Id: default May 16 17:33:18.383967 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-User-Domain-Name: Default May 16 17:33:18.383967 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-User-Id: 4463e4c93e664f46a81171f07eadb93c May 16 17:33:18.383967 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-User-Name: admin May 16 17:33:18.383967 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: method: > May 16 17:33:18.383967 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: exception: Flavor 84 could not be found. May 16 17:33:18.383967 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: action_args: {'id': '84'} May 16 17:33:18.383967 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:33:18.383967 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:33:18.384937 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:33:18.386037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:33:18.386037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:33:18.386037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:33:18.386037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:33:18.386037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 17:33:18.386037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 17:33:18.386037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 16 17:33:18.386037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi May 16 17:33:18.386037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:33:18.386037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi May 16 17:33:18.386037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:33:18.386037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:33:18.386037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:33:18.386037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:33:18.386037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:33:18.386037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 16 17:33:18.386037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi May 16 17:33:18.386037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-c6ceccbc-58a8-4d5e-900f-4e2881e59a25 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:33:18.387134 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-c6ceccbc-58a8-4d5e-900f-4e2881e59a25 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.071383 May 16 17:33:18.387134 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 22/44] 10.222.0.58 () {60 vars in 1190 bytes} [Mon May 16 17:33:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 17:33:18.394399 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-6c366aba-e8ee-4d12-a479-0bb089f45492 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:18.408546 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-6c366aba-e8ee-4d12-a479-0bb089f45492 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017916 May 16 17:33:18.409118 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 23/45] 10.222.0.58 () {60 vars in 1210 bytes} [Mon May 16 17:33:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:33:18.421513 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-33b6cff6-b140-4add-9d5c-4fd35ad4a570 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:18.441361 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-33b6cff6-b140-4add-9d5c-4fd35ad4a570 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025713 May 16 17:33:18.441943 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 23/46] 10.222.0.58 () {60 vars in 1210 bytes} [Mon May 16 17:33:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:33:18.451203 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-ee4d7d96-d59d-4789-98f9-02cc6238074b admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:18.456836 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.wsgi [None req-ee4d7d96-d59d-4789-98f9-02cc6238074b admin admin] HTTP exception thrown: Flavor 84 could not be found. May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-ee4d7d96-d59d-4789-98f9-02cc6238074b admin admin] Request method failure captured: May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Accept: application/json May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Accept-Encoding: gzip, deflate May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Connection: keep-alive May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Content-Length: 0 May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Host: 10.222.0.58 May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Openstack-Api-Version: compute 2.90 May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Openstack-System-Scope: None May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: User-Agent: python-novaclient May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Auth-Token: gAAAAABigoresPMEWWxUqagfh-GCOpznP2mTRodOCXVTLWHUc_1L57exwVQ0tDv3h_GVwyywo1-4pRadZSDlwwejVykv8Ibdrf1dSUjJ7WwNZcI1G9VoL3WA9GnUm1zOAm9kqkIiPC55hphP2pTC_TozsR2noLTZT4ARohQX7BGCh8LbgIiUNW8 May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Domain-Id: None May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Domain-Name: None May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Identity-Status: Confirmed May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Is-Admin-Project: True May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Openstack-Nova-Api-Version: 2.90 May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Project-Domain-Id: default May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Project-Domain-Name: Default May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Project-Id: ab7c1a113cb54758aa563ff3298e430c May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Project-Name: admin May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Role: admin,reader,member May 16 17:33:18.458387 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Roles: admin,reader,member May 16 17:33:18.459880 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab7c1a113cb54758aa563ff3298e430c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ab7c1a113cb54758aa563ff3298e430c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ab7c1a113cb54758aa563ff3298e430c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab7c1a113cb54758aa563ff3298e430c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:33:18.459880 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Tenant: admin May 16 17:33:18.459880 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Tenant-Id: ab7c1a113cb54758aa563ff3298e430c May 16 17:33:18.459880 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Tenant-Name: admin May 16 17:33:18.459880 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-User: admin May 16 17:33:18.459880 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-User-Domain-Id: default May 16 17:33:18.459880 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-User-Domain-Name: Default May 16 17:33:18.459880 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-User-Id: 4463e4c93e664f46a81171f07eadb93c May 16 17:33:18.459880 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-User-Name: admin May 16 17:33:18.459880 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: method: > May 16 17:33:18.459880 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: exception: Flavor 84 could not be found. May 16 17:33:18.459880 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: action_args: {'id': '84'} May 16 17:33:18.459880 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:33:18.459880 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:33:18.460846 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:33:18.461992 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:33:18.461992 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:33:18.461992 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:33:18.461992 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:33:18.461992 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 17:33:18.461992 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 17:33:18.461992 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 16 17:33:18.461992 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi May 16 17:33:18.461992 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:33:18.461992 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi May 16 17:33:18.461992 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:33:18.461992 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:33:18.461992 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:33:18.461992 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:33:18.461992 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:33:18.461992 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 16 17:33:18.461992 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi May 16 17:33:18.461992 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-ee4d7d96-d59d-4789-98f9-02cc6238074b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:33:18.463013 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-ee4d7d96-d59d-4789-98f9-02cc6238074b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012094 May 16 17:33:18.463013 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 24/47] 10.222.0.58 () {60 vars in 1190 bytes} [Mon May 16 17:33:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 17:33:19.333803 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-33b6cff6-b140-4add-9d5c-4fd35ad4a570 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:19.334857 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-33b6cff6-b140-4add-9d5c-4fd35ad4a570 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 May 16 17:33:19.335292 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 24/48] 10.222.0.58 () {56 vars in 1074 bytes} [Mon May 16 17:33:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:33:19.521512 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-8979ace3-8508-4f3f-8a46-44d71969d1ac admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:19.527646 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.wsgi [None req-8979ace3-8508-4f3f-8a46-44d71969d1ac admin admin] HTTP exception thrown: Flavor 451 could not be found. May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-8979ace3-8508-4f3f-8a46-44d71969d1ac admin admin] Request method failure captured: May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Accept: application/json May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Accept-Encoding: gzip, deflate May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Connection: keep-alive May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Content-Length: 0 May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Host: 10.222.0.58 May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Openstack-Api-Version: compute 2.90 May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Openstack-System-Scope: None May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: User-Agent: python-novaclient May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Auth-Token: gAAAAABigorftHdAiJwl5okbriYw3SfsrgyDqrv6mWjepzgeTgOZWS-EVz2mS4LW7VdPGzT6cXwkryBiAYbBB7b1TsrxSXv0bRIXrziY58faB6yYJv0NkP-PhB-TlowHOPaAFdpi_MxTJCDzbPI4wIO3ycZkV6GA1CY9A5r79JKVvgSJEMG4qpk May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Domain-Id: None May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Domain-Name: None May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Identity-Status: Confirmed May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Is-Admin-Project: True May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Openstack-Nova-Api-Version: 2.90 May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Project-Domain-Id: default May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Project-Domain-Name: Default May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Project-Id: ab7c1a113cb54758aa563ff3298e430c May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Project-Name: admin May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Role: admin,reader,member May 16 17:33:19.529135 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Roles: admin,reader,member May 16 17:33:19.530607 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab7c1a113cb54758aa563ff3298e430c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ab7c1a113cb54758aa563ff3298e430c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ab7c1a113cb54758aa563ff3298e430c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab7c1a113cb54758aa563ff3298e430c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:33:19.530607 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Tenant: admin May 16 17:33:19.530607 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Tenant-Id: ab7c1a113cb54758aa563ff3298e430c May 16 17:33:19.530607 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-Tenant-Name: admin May 16 17:33:19.530607 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-User: admin May 16 17:33:19.530607 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-User-Domain-Id: default May 16 17:33:19.530607 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-User-Domain-Name: Default May 16 17:33:19.530607 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-User-Id: 4463e4c93e664f46a81171f07eadb93c May 16 17:33:19.530607 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: X-User-Name: admin May 16 17:33:19.530607 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: method: > May 16 17:33:19.530607 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: exception: Flavor 451 could not be found. May 16 17:33:19.530607 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: action_args: {'id': '451'} May 16 17:33:19.530607 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:33:19.530607 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:33:19.531578 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:33:19.532940 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:33:19.532940 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:33:19.532940 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:33:19.532940 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:33:19.532940 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 17:33:19.532940 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 17:33:19.532940 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 16 17:33:19.532940 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi May 16 17:33:19.532940 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:33:19.532940 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi May 16 17:33:19.532940 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:33:19.532940 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:33:19.532940 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:33:19.532940 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:33:19.532940 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:33:19.532940 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 16 17:33:19.532940 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: ERROR nova.api.openstack.wsgi May 16 17:33:19.532940 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-8979ace3-8508-4f3f-8a46-44d71969d1ac admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:33:19.534214 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-8979ace3-8508-4f3f-8a46-44d71969d1ac admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063018 May 16 17:33:19.534214 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 25/49] 10.222.0.58 () {60 vars in 1193 bytes} [Mon May 16 17:33:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 17:33:19.543208 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-67b16d28-f58d-47e5-bd9a-f804265cc153 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:19.558500 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-67b16d28-f58d-47e5-bd9a-f804265cc153 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021479 May 16 17:33:19.559037 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 25/50] 10.222.0.58 () {60 vars in 1210 bytes} [Mon May 16 17:33:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:33:19.568230 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-a338f7f6-6e81-4910-aeab-3ba33ba07526 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:19.581859 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-a338f7f6-6e81-4910-aeab-3ba33ba07526 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017094 May 16 17:33:19.582369 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 26/51] 10.222.0.58 () {60 vars in 1210 bytes} [Mon May 16 17:33:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:33:19.591594 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-ddc05073-4a06-4838-ac55-b31695864e2e admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:19.596910 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.wsgi [None req-ddc05073-4a06-4838-ac55-b31695864e2e admin admin] HTTP exception thrown: Flavor 451 could not be found. May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-ddc05073-4a06-4838-ac55-b31695864e2e admin admin] Request method failure captured: May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Accept: application/json May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Accept-Encoding: gzip, deflate May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Connection: keep-alive May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Content-Length: 0 May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Host: 10.222.0.58 May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Openstack-Api-Version: compute 2.90 May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Openstack-System-Scope: None May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: User-Agent: python-novaclient May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Auth-Token: gAAAAABigorftHdAiJwl5okbriYw3SfsrgyDqrv6mWjepzgeTgOZWS-EVz2mS4LW7VdPGzT6cXwkryBiAYbBB7b1TsrxSXv0bRIXrziY58faB6yYJv0NkP-PhB-TlowHOPaAFdpi_MxTJCDzbPI4wIO3ycZkV6GA1CY9A5r79JKVvgSJEMG4qpk May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Domain-Id: None May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Domain-Name: None May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Identity-Status: Confirmed May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Is-Admin-Project: True May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Openstack-Nova-Api-Version: 2.90 May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Project-Domain-Id: default May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Project-Domain-Name: Default May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Project-Id: ab7c1a113cb54758aa563ff3298e430c May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Project-Name: admin May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Role: admin,reader,member May 16 17:33:19.598436 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Roles: admin,reader,member May 16 17:33:19.599762 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab7c1a113cb54758aa563ff3298e430c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ab7c1a113cb54758aa563ff3298e430c", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ab7c1a113cb54758aa563ff3298e430c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ab7c1a113cb54758aa563ff3298e430c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:33:19.599762 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Tenant: admin May 16 17:33:19.599762 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Tenant-Id: ab7c1a113cb54758aa563ff3298e430c May 16 17:33:19.599762 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-Tenant-Name: admin May 16 17:33:19.599762 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-User: admin May 16 17:33:19.599762 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-User-Domain-Id: default May 16 17:33:19.599762 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-User-Domain-Name: Default May 16 17:33:19.599762 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-User-Id: 4463e4c93e664f46a81171f07eadb93c May 16 17:33:19.599762 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: X-User-Name: admin May 16 17:33:19.599762 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: method: > May 16 17:33:19.599762 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: exception: Flavor 451 could not be found. May 16 17:33:19.599762 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: action_args: {'id': '451'} May 16 17:33:19.599762 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:33:19.599762 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:33:19.601583 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:33:19.602845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:33:19.602845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:33:19.602845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:33:19.602845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:33:19.602845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 17:33:19.602845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 17:33:19.602845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 16 17:33:19.602845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi May 16 17:33:19.602845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:33:19.602845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi May 16 17:33:19.602845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:33:19.602845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:33:19.602845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:33:19.602845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:33:19.602845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:33:19.602845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 16 17:33:19.602845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi May 16 17:33:19.602845 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-ddc05073-4a06-4838-ac55-b31695864e2e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:33:19.604107 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-ddc05073-4a06-4838-ac55-b31695864e2e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011739 May 16 17:33:19.604107 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 26/52] 10.222.0.58 () {60 vars in 1193 bytes} [Mon May 16 17:33:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 17:33:20.485669 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-a338f7f6-6e81-4910-aeab-3ba33ba07526 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:20.486677 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-a338f7f6-6e81-4910-aeab-3ba33ba07526 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 16 17:33:20.487068 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 27/53] 10.222.0.58 () {56 vars in 1074 bytes} [Mon May 16 17:33:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:33:20.675584 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-376a3a06-5711-46e9-a13a-c8223fd428d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:33:20.694044 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-376a3a06-5711-46e9-a13a-c8223fd428d4 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072348 May 16 17:33:20.694582 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 27/54] 10.222.0.58 () {64 vars in 1235 bytes} [Mon May 16 17:33:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:33:21.588266 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-a338f7f6-6e81-4910-aeab-3ba33ba07526 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:21.589263 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-a338f7f6-6e81-4910-aeab-3ba33ba07526 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 16 17:33:21.589682 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 28/55] 10.222.0.58 () {56 vars in 1074 bytes} [Mon May 16 17:33:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:33:21.787262 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-59131e52-fb80-4a40-9d56-2149783e3b42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:33:21.808101 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-59131e52-fb80-4a40-9d56-2149783e3b42 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.083124 May 16 17:33:21.808565 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 28/56] 10.222.0.58 () {64 vars in 1235 bytes} [Mon May 16 17:33:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:33:22.699566 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-a338f7f6-6e81-4910-aeab-3ba33ba07526 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:22.700531 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-a338f7f6-6e81-4910-aeab-3ba33ba07526 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 16 17:33:22.700932 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 29/57] 10.222.0.58 () {56 vars in 1074 bytes} [Mon May 16 17:33:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:33:22.896245 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-ed911795-e737-4ace-bc18-00e16ec3f15c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:33:22.916199 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-ed911795-e737-4ace-bc18-00e16ec3f15c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.081119 May 16 17:33:22.916663 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 29/58] 10.222.0.58 () {64 vars in 1235 bytes} [Mon May 16 17:33:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 17:33:23.813010 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-a338f7f6-6e81-4910-aeab-3ba33ba07526 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:23.814355 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-a338f7f6-6e81-4910-aeab-3ba33ba07526 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001877 May 16 17:33:23.814885 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 30/59] 10.222.0.58 () {56 vars in 1074 bytes} [Mon May 16 17:33:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:33:24.019264 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-125e7914-8dd3-48cb-b7d6-ec66f2014356 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:33:24.039216 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-125e7914-8dd3-48cb-b7d6-ec66f2014356 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.077032 May 16 17:33:24.039755 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 30/60] 10.222.0.58 () {64 vars in 1235 bytes} [Mon May 16 17:33:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:33:24.918880 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-a338f7f6-6e81-4910-aeab-3ba33ba07526 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:24.919896 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-a338f7f6-6e81-4910-aeab-3ba33ba07526 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 16 17:33:24.920319 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 31/61] 10.222.0.58 () {56 vars in 1074 bytes} [Mon May 16 17:33:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:33:25.119345 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-7ab5312e-b550-4c62-b7f5-ca0ad1e6d653 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:33:25.138537 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-7ab5312e-b550-4c62-b7f5-ca0ad1e6d653 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.085516 May 16 17:33:25.139078 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 31/62] 10.222.0.58 () {60 vars in 1202 bytes} [Mon May 16 17:33:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:34:26.826672 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-a338f7f6-6e81-4910-aeab-3ba33ba07526 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:34:26.827773 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-a338f7f6-6e81-4910-aeab-3ba33ba07526 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 May 16 17:34:26.828145 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 32/63] 10.222.0.58 () {54 vars in 930 bytes} [Mon May 16 17:34:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:34:26.890198 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-34ece756-6b65-457c-9dc4-ea0d244f6d4e admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:34:26.909432 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-34ece756-6b65-457c-9dc4-ea0d244f6d4e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075104 May 16 17:34:26.910021 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 32/64] 10.222.0.58 () {60 vars in 1291 bytes} [Mon May 16 17:34:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:34:26.932591 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-c419ebf9-3c5e-4ef0-ae3a-aef7b89e2c39 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:34:26.943018 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-c419ebf9-3c5e-4ef0-ae3a-aef7b89e2c39 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014396 May 16 17:34:26.943838 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 33/65] 10.222.0.58 () {60 vars in 1282 bytes} [Mon May 16 17:34:26 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:34:26.961828 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-39141e0c-6d2b-4680-8034-7346c5055b02 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:34:26.971958 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-39141e0c-6d2b-4680-8034-7346c5055b02 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016353 May 16 17:34:26.972519 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 33/66] 10.222.0.58 () {60 vars in 1285 bytes} [Mon May 16 17:34:26 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:34:26.983519 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-67087268-9e14-4588-a32c-3861c27584a6 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:34:26.991369 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-67087268-9e14-4588-a32c-3861c27584a6 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011383 May 16 17:34:26.991898 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 34/67] 10.222.0.58 () {60 vars in 1285 bytes} [Mon May 16 17:34:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:34:27.003172 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-766acbdf-04a9-4da2-b772-6f8b6e3cf313 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:34:27.011248 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-766acbdf-04a9-4da2-b772-6f8b6e3cf313 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011623 May 16 17:34:27.011768 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 34/68] 10.222.0.58 () {60 vars in 1282 bytes} [Mon May 16 17:34:26 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:37:54.451372 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-67087268-9e14-4588-a32c-3861c27584a6 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:54.452389 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-67087268-9e14-4588-a32c-3861c27584a6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 16 17:37:54.452787 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 35/69] 10.222.0.58 () {56 vars in 1074 bytes} [Mon May 16 17:37:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:37:54.738894 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-4178e861-c0c2-4fa3-b0db-926cfef109df admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:54.740120 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 17:37:54.740120 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: warnings.warn(msg) May 16 17:37:54.741328 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-4178e861-c0c2-4fa3-b0db-926cfef109df admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:54.741791 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-4178e861-c0c2-4fa3-b0db-926cfef109df admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:54.742595 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-4178e861-c0c2-4fa3-b0db-926cfef109df admin admin] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:54.743019 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-4178e861-c0c2-4fa3-b0db-926cfef109df admin admin] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:54.780178 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-4178e861-c0c2-4fa3-b0db-926cfef109df admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.174966 May 16 17:37:54.780784 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 35/70] 10.222.0.58 () {60 vars in 1193 bytes} [Mon May 16 17:37:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:37:55.702341 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-67087268-9e14-4588-a32c-3861c27584a6 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:55.703393 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-67087268-9e14-4588-a32c-3861c27584a6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 16 17:37:55.703811 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 36/71] 10.222.0.58 () {56 vars in 1074 bytes} [Mon May 16 17:37:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:37:55.899036 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-01ae365f-1a2b-4112-90ef-9d461ca965d7 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:37:55.900217 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 17:37:55.900217 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: warnings.warn(msg) May 16 17:37:55.901393 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-01ae365f-1a2b-4112-90ef-9d461ca965d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:55.901847 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-01ae365f-1a2b-4112-90ef-9d461ca965d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:55.902646 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-01ae365f-1a2b-4112-90ef-9d461ca965d7 admin admin] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:37:55.903058 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-01ae365f-1a2b-4112-90ef-9d461ca965d7 admin admin] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:37:55.921732 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-01ae365f-1a2b-4112-90ef-9d461ca965d7 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075235 May 16 17:37:55.922582 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 36/72] 10.222.0.58 () {60 vars in 1193 bytes} [Mon May 16 17:37:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:38:07.255900 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-67087268-9e14-4588-a32c-3861c27584a6 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:38:07.256905 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-67087268-9e14-4588-a32c-3861c27584a6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 16 17:38:07.257305 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 37/73] 10.222.0.58 () {56 vars in 1074 bytes} [Mon May 16 17:38:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:38:07.464012 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-ff848b05-6d27-4fd6-b9ba-7238f2246a88 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:38:07.465201 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 17:38:07.465201 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: warnings.warn(msg) May 16 17:38:07.466434 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-ff848b05-6d27-4fd6-b9ba-7238f2246a88 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:38:07.466894 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-ff848b05-6d27-4fd6-b9ba-7238f2246a88 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:38:07.467663 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-ff848b05-6d27-4fd6-b9ba-7238f2246a88 admin admin] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:38:07.468076 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-ff848b05-6d27-4fd6-b9ba-7238f2246a88 admin admin] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:38:07.492024 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-ff848b05-6d27-4fd6-b9ba-7238f2246a88 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.098100 May 16 17:38:07.492499 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 37/74] 10.222.0.58 () {60 vars in 1193 bytes} [Mon May 16 17:38:07 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:38:08.377351 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: DEBUG nova.api.openstack.wsgi [None req-67087268-9e14-4588-a32c-3861c27584a6 admin admin] Calling method '>' {{(pid=103636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:38:08.378394 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: INFO nova.api.openstack.requestlog [None req-67087268-9e14-4588-a32c-3861c27584a6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 16 17:38:08.378828 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: [pid: 103636|app: 0|req: 38/75] 10.222.0.58 () {56 vars in 1074 bytes} [Mon May 16 17:38:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:38:08.577080 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-ca2f47d0-7f29-403c-ad10-aff1be63f0bc admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:38:08.578911 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 17:38:08.578911 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: warnings.warn(msg) May 16 17:38:08.580250 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-ca2f47d0-7f29-403c-ad10-aff1be63f0bc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:38:08.580681 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-ca2f47d0-7f29-403c-ad10-aff1be63f0bc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:38:08.581465 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-ca2f47d0-7f29-403c-ad10-aff1be63f0bc admin admin] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:38:08.581909 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-ca2f47d0-7f29-403c-ad10-aff1be63f0bc admin admin] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:38:08.603996 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-ca2f47d0-7f29-403c-ad10-aff1be63f0bc admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088979 May 16 17:38:08.604548 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 38/76] 10.222.0.58 () {60 vars in 1193 bytes} [Mon May 16 17:38:08 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:39:06.539199 dv-cinder-837699-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 16 17:39:06.539979 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: Mon May 16 17:39:06 2022 - graceful shutdown triggered... May 16 17:39:06.540449 dv-cinder-837699-6-iscsi devstack@n-api.service[103637]: Gracefully killing worker 2 (pid: 103637)... May 16 17:39:06.540832 dv-cinder-837699-6-iscsi devstack@n-api.service[103636]: Gracefully killing worker 1 (pid: 103636)... May 16 17:39:07.540509 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: worker 1 buried after 1 seconds May 16 17:39:07.540509 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: worker 2 buried after 1 seconds May 16 17:39:07.540509 dv-cinder-837699-6-iscsi devstack@n-api.service[103631]: goodbye to uWSGI. May 16 17:39:07.543117 dv-cinder-837699-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 16 17:39:07.544043 dv-cinder-837699-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 16 17:39:07.548723 dv-cinder-837699-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 16 17:39:07.567445 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 16 17:39:07.583321 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 17:39:07 2022] *** May 16 17:39:07.583321 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 17:39:07.583321 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 17:39:07.583321 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: nodename: dv-cinder-837699-6-iscsi May 16 17:39:07.583321 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: machine: x86_64 May 16 17:39:07.583321 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: clock source: unix May 16 17:39:07.583321 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: pcre jit disabled May 16 17:39:07.583321 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: detected number of CPU cores: 4 May 16 17:39:07.583321 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: current working directory: / May 16 17:39:07.583321 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: detected binary path: /usr/bin/uwsgi-core May 16 17:39:07.583321 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: your processes number limit is 47680 May 16 17:39:07.583321 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: your memory page size is 4096 bytes May 16 17:39:07.583321 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: detected max file descriptor number: 2048 May 16 17:39:07.583321 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: lock engine: pthread robust mutexes May 16 17:39:07.584310 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: thunder lock: enabled May 16 17:39:07.584310 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 16 17:39:07.584310 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 17:39:07.629520 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: Python main interpreter initialized at 0x563c793b09c0 May 16 17:39:07.629520 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: python threads support enabled May 16 17:39:07.629520 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: your server socket listen backlog is limited to 100 connections May 16 17:39:07.629520 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: your mercy for graceful operations on workers is 90 seconds May 16 17:39:07.630071 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: mapped 403077 bytes (393 KB) for 2 cores May 16 17:39:07.630071 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: *** Operational MODE: preforking *** May 16 17:39:07.630225 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: *** uWSGI is running in multiple interpreter mode *** May 16 17:39:07.630225 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: spawned uWSGI master process (pid: 128791) May 16 17:39:07.630459 dv-cinder-837699-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 16 17:39:07.631696 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: spawned uWSGI worker 1 (pid: 128815, cores: 1) May 16 17:39:07.632050 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: spawned uWSGI worker 2 (pid: 128816, cores: 1) May 16 17:39:07.632362 dv-cinder-837699-6-iscsi devstack@n-api.service[128791]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 17:39:08.824057 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 17:39:08.831368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 17:39:09.616235 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 17:39:09.616235 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: from cryptography.utils import int_from_bytes May 16 17:39:09.616663 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 17:39:09.616663 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: from cryptography.utils import int_from_bytes May 16 17:39:09.617941 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 17:39:09.617941 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: from cryptography.utils import int_from_bytes May 16 17:39:09.618235 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 17:39:09.618235 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: from cryptography.utils import int_from_bytes May 16 17:39:11.999799 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 17:39:12.000565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 17:39:12.000565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 17:39:12.000940 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 17:39:12.001197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 17:39:12.001617 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.001983 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.002311 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.002609 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.002944 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.003295 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.003625 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.003949 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.004284 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.004521 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.004854 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.005175 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837699-6-iscsi {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.005534 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.005858 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.006210 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.006534 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.006844 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.007180 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.007529 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.008006 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 17:39:12.008414 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.008518 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 17:39:12.008808 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 17:39:12.009326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 17:39:12.009453 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 17:39:12.009647 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.009877 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.010114 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.010321 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.010549 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.010764 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.010977 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.011183 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.011396 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.011622 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.011862 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.012080 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.012309 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.012532 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.012736 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.012972 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.013221 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.013435 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.013759 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.013984 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.014228 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837699-6-iscsi {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.014463 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.014677 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.014864 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837699-6-iscsi {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.015081 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.015238 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.015428 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.015603 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.015795 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.015952 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.016097 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.016271 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.016463 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.016616 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.016809 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.016976 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.016976 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.017275 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.017275 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.017585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.017825 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.017984 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.018143 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.018297 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.018448 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.021090 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.021392 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.022436 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.022631 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.022792 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.023046 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.023210 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.023362 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.023517 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.023677 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.023832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.023981 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.024124 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.024265 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.024412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.024569 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.024569 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.024854 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837699-6-iscsi {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.025004 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.025167 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.025326 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.025479 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.025677 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.025839 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.025992 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.025992 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.026285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.026285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.026578 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.026721 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.026870 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.026870 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.027177 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.027331 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.027481 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.027628 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.027787 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.027947 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.028100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.028251 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.028400 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.028644 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.028803 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.028965 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.029107 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.029248 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.029389 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.029529 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.029722 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.029866 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.030014 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.030166 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.030318 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.030466 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.030621 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.030764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.030922 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.030922 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.031192 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.031192 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.031476 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.031617 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.031783 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.032547 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.032798 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.032960 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.033119 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.033119 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.033432 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.033619 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.033787 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.033940 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.034094 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.034237 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.034387 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.034534 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.034685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.034834 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.034976 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.035127 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.035287 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.035438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.035597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.035738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.035886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.036035 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.036185 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.036326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.036484 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.036636 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.036778 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.036925 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.037077 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.037309 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.037462 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.037678 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.037833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.037975 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.038116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.038116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.038406 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.038548 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.038731 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.038878 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.039029 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.039187 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.039343 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.039497 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.039644 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.039798 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.039940 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.040093 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.040234 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.040383 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.040532 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.040681 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.040830 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.040988 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.041145 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.041294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.041445 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.041626 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.041790 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.041934 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.042592 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.042860 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.043098 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.043254 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.043406 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.043559 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.043708 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.043871 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.044014 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.044155 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.044297 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.044447 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.044601 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.044760 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.044903 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.045051 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.045193 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.045341 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.045483 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.045675 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.045834 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.045987 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.046128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.046276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.046418 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.046891 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.047034 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.047184 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.047331 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.047481 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.047636 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.047779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.047927 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.048091 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.048234 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.048390 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.048541 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.048683 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.048826 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.048974 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.049123 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.049271 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.049421 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.049592 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.049754 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.049899 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.050585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.050708 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.050808 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.050891 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.050971 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.051056 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.051137 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.051216 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.051287 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.051363 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.051439 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.051523 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.051607 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.051679 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.051748 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.051830 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.051918 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.051989 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.052065 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.052143 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.052220 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.052297 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.052376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.052452 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.052529 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.052604 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.052684 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.052761 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.052843 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.052919 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.052989 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.053066 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.053145 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.053225 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.053295 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.053371 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.053441 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.053441 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.053599 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.053696 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.053775 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.053852 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.053928 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.053928 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.054093 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.054202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.054274 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.054351 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.054426 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.054504 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.054585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.054663 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.054734 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.054803 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.054873 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.054942 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.055018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.055095 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.055165 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.055234 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.055302 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 17:39:12.055371 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.055447 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.055518 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.055593 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.055689 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.055766 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.055837 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.055919 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.056002 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.056079 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.056157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.056237 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.056308 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.056376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.056454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.056531 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.056601 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.056669 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.056739 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.056807 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.056888 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.056959 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.057028 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.057103 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.057173 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.057305 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.057385 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.057462 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.057532 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.057622 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.057703 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.058431 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.058431 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.058660 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.059143 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.059306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.059525 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.059703 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.059861 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.060527 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.060711 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.060854 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.061002 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.061155 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.061296 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.061443 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.061622 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.061622 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.061902 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.062052 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.062197 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.062344 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.062482 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.062637 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.062788 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.062927 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.063075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.063215 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.063360 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.063508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.063663 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.063809 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.063947 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.064084 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.064228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.064386 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.064540 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.064687 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.064833 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.064978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.065123 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.065270 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.065425 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.065593 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.065740 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.065890 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.066036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.066190 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.066349 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.066494 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.066639 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.066777 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.066921 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.067078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.067216 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.067352 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.067497 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.067635 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.067776 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.067925 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.068073 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.068380 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.069147 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.069321 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.069321 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.069632 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.069813 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.069963 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.070113 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.070365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.070522 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.070670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.070818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.070965 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.071116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.071264 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.071426 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.071573 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.071712 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.071852 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.071998 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.072136 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.072283 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.072422 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.072569 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.072706 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.072856 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.073001 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.073153 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.073299 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.073448 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.073661 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.073816 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.073970 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.074111 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.074256 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.074403 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.074547 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.074694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.074857 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.074999 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.075137 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.075286 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.075432 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.075571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.075717 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.075872 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.076013 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.076161 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.076161 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.076421 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.076573 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.076729 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.076868 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.077011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.077158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.077310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.077457 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.077622 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.077780 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.077920 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.078066 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.078423 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.078631 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.078787 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.078942 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.079088 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.079274 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.079435 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.079598 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.079749 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.079924 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.080076 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.080246 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.080422 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.080659 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.080810 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.080960 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.081117 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.081266 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.081409 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.081586 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.081742 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.081891 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.082029 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.082177 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.082326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.082476 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.082618 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.082755 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.082946 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.083107 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.083288 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.083443 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.083621 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.083767 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.083939 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.084100 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.084270 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.084423 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.084591 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.084745 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.084898 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.085048 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.085213 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.085441 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.085610 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.085766 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.085915 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.086053 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.086223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.086377 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.086526 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.086675 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.086845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.087000 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.087158 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.087304 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.087482 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.087637 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.087854 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.088000 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.088137 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.088274 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.088552 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.088716 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.088867 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.089014 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.089163 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.089340 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.089487 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.089682 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.089963 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.090109 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.090306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.090464 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.090734 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.090902 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.091042 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.091181 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.091326 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.091475 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.091612 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.091763 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.091911 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.092056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.092202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.092349 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.092494 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.092641 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.092787 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.092926 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.093072 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.093210 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.093388 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.093541 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.093750 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.093896 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.094074 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.094220 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.094394 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.094548 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.094696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.094834 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.095013 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.095159 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.095334 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.095497 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.095638 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.095775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.096000 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.096153 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.096347 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.096491 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.096679 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.096831 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.096998 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.097154 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.097308 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.097447 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.097664 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.097822 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.097963 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.098110 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.098257 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.098640 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.098796 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.098943 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.099081 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.099229 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.099374 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.099527 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.099681 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.099830 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.100066 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.100222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.100397 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.100543 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.100691 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.100862 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.101128 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.101282 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.101429 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.101631 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.101778 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.102514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.102669 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.102818 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.102998 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.103151 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.103298 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.103445 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.103585 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.103730 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.103898 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.104047 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.104194 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.104351 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.104498 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.104636 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.104783 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.104921 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.105059 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.105210 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.105350 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.105499 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.105677 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.105832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.105972 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.106168 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.106312 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.106480 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.106640 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.106780 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.106919 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.107056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.107201 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.107349 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.107488 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.107634 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.107634 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.107908 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.108056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.108204 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.108350 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.108497 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.108877 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.109026 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.109166 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.109315 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.109315 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.109629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.109776 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.109914 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.110052 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.110208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.110357 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.110504 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.110657 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.110813 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.110952 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.111114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.111354 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.111499 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.111648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.111648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.111928 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.112068 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.112224 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.112371 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.112519 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.112658 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.112798 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.112937 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.113076 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.113214 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.113360 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.113507 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.113677 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.113819 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.113980 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.114129 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.114312 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.114459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.114643 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.114794 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.114965 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.115123 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.115270 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.115408 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.115599 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.115745 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.115923 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.116155 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.116296 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.116441 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.116671 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.116833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.116988 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.117147 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.117292 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.117438 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.117709 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.117875 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.118026 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.118169 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.118313 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.118459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.118628 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.119013 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.119176 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.119327 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.119327 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.119600 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.119739 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.119887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.120040 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.120187 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.120336 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.120481 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.120621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.120768 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.120913 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.121089 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.121234 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.121392 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.121655 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.121814 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.121955 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.122094 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.122240 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.122398 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.122538 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.122698 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.122844 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.122990 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.123145 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.123299 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.123478 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.123641 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.123842 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.124000 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.124147 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.124301 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.124466 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.124619 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.124766 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.124911 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.125068 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.125221 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.125368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.125513 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.125729 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.125887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.126047 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.126200 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.126353 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.126509 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.126654 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.126814 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.126968 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.127120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.127266 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.127416 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.127563 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.127727 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.127882 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.128036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.128182 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.128333 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.128491 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.128645 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.128790 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.129102 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.129271 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.129433 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.129609 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.129774 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.129921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.129921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.130203 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.130357 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.130527 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.130682 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.130836 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.130999 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.131154 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.131300 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.131453 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.131608 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.131864 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.132025 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.132203 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.132356 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.132511 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.132669 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.132814 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.132966 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.133112 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.133266 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.133428 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.133607 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.133770 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.133917 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.134061 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.134215 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.134361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.134505 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.134661 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.134814 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.134969 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.135123 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.135276 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.135423 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.135570 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.135714 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.135860 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.136015 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.136161 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.136313 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.136458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.136621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.136776 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.136932 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.137079 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.137230 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.137384 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.137536 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.137717 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.137870 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.138024 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.138215 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.138376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.138533 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.138687 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.138832 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.139031 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.139322 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.139473 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.139627 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.139829 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.139979 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.140125 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.140270 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.140413 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.140564 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.140733 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.140886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.141035 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.141181 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.141325 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.141484 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.141665 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.141822 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.144717 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.144856 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.144986 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.145122 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.145239 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.145355 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.145476 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.145641 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.145775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.145899 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.146011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.146129 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.146239 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.146351 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.146469 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.146469 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.146694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.146819 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.146938 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.147049 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.147171 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.147291 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.147410 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.147522 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.147639 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.147757 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.147946 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.148064 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.148174 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.148284 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.148395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.148513 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.148692 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.148824 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.149024 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.149118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.149214 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.149301 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.149396 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.149491 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.149651 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.149753 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.149849 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.151286 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.151391 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.151486 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.151573 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.151682 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.151763 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.151853 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.151949 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.152042 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.152135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.152227 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.152313 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.152406 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.152494 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.152591 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.152679 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.152771 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.152858 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.152951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.153045 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.153139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.153233 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.153340 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.153437 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.153530 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.153692 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.153821 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.153951 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.154092 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.154230 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.154321 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.154321 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.154484 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.154596 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.154729 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.154885 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.154975 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.155067 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.155207 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.155207 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.155367 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.155463 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.155552 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.155645 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.155730 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.155814 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.155898 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.155996 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.156081 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.156213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.156316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.156528 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.156631 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.156859 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.156954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.157175 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.157276 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.157507 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.157732 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.157899 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.158057 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.158269 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.158419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.158568 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.158721 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.158972 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.159138 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.159293 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.159440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.159616 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.159793 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.159954 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.160109 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.160271 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.160425 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.160586 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.160741 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.160904 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.161059 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.161409 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.161593 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.161762 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.161910 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.162064 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.162220 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.162220 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.162506 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.162506 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.162795 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.162949 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.163106 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.163251 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.163439 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.163773 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.163929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.164084 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.164230 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.164384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.164546 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.164546 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.164920 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.164920 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.165228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.165376 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.165531 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.165735 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.165893 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.166048 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.166202 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.166202 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.166500 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.166656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.166802 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.166802 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.167094 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.167260 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.167407 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.167560 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.167706 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.167851 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.168005 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.168162 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.168317 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.168479 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.168626 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.168779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.168934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.169081 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.169243 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.169391 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.169536 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.169717 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.169872 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.170019 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.170165 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.170309 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.170464 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.170634 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.170789 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.170950 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.171108 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.171282 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.171867 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.172036 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.172184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.172338 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.172491 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.172646 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.172792 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.172951 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.173105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.173259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.173405 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.173597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.173597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.174020 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.174175 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.174320 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.174473 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.174629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.174789 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.174951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.175162 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.175312 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.175458 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.175603 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.175770 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.176015 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.176166 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.176320 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.176476 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.176632 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.176863 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.177013 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.177160 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.177305 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.177450 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.177631 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.177801 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.177967 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.178120 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.178266 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.178413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.178572 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.178728 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.178883 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.179060 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.179289 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.179445 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.179602 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.179758 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.179758 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.180050 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.180207 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.180353 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.180508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.180660 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.180856 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.181011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.181166 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.181322 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.181489 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.181690 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.181961 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.182138 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.182297 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.182458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.182616 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.182762 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.182908 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.183053 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.183206 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.183361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.183508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.183662 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.183811 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.184062 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.184242 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.184390 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.184554 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.184704 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.184858 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.185005 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.185179 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.185391 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.185541 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.185721 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.185876 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.186022 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.186192 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.186347 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.186502 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.186647 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.186793 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.186937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.187092 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.187239 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.187394 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.187551 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.187736 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.187902 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.188064 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.188229 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.188376 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.188521 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.188674 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.188829 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.188976 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.189121 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.189274 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.189428 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.189428 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.189766 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.189915 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.190068 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.190232 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.190388 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.190542 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.190702 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.190857 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.191004 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.191149 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.191295 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.191450 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.191604 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.191757 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.191910 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.192166 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.192320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.192320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.192610 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.192610 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.192906 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.193203 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.193358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.193519 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.193719 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.193878 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.194050 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.194256 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.194386 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.194529 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.194684 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.194813 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.194946 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.195079 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.195219 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.195336 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.195536 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.195665 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.195790 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.195917 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.196056 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.196181 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.196315 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.196440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.196574 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.196721 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.196887 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.197012 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.197144 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.197277 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.197277 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.197525 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.197525 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.197805 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.197805 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.198058 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.198058 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.198305 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.198431 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.198564 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.198697 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.198831 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.198957 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.199095 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.199229 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.199354 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.199503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.199632 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.199846 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.199977 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.200175 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.200320 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.205679 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.205905 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.205905 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.206852 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.207003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.207219 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.207219 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.207533 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.207676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.207769 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.207856 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.207943 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.208027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.208128 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.208237 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.208332 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.208427 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.208514 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.208608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.208695 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.208790 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.208879 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.208879 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.209042 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.209142 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.209229 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.209321 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.209407 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.209501 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.209621 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.209799 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.209889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.209889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.210072 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.210163 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.210257 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.210430 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.210524 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.210617 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.210710 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.210796 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.210890 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.211053 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.211144 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.211255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.211344 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.211439 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.211536 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.211624 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.211710 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.211794 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.211902 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.211998 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.212093 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.212178 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.212280 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.212361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.212436 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.212528 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.212623 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.212708 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.212793 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.212878 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.212974 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.213073 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.213169 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.213258 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.213343 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.213435 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.213530 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.213691 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.213806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.213934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.214028 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.214113 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.214224 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.214311 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.214397 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.214480 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.214571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.214724 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.214827 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.214921 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.215007 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.215091 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.215176 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.215268 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.215423 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.215536 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.215646 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.215754 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.215871 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.215997 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.216099 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.216228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.216329 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.216329 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.216503 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.216601 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.216687 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.216771 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.216863 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.216999 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.217100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.217197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.217428 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.217607 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.217784 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.217926 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.218112 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.218273 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.218456 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.218598 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.218773 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.218926 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.219060 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.219164 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.219404 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.219542 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.219726 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.219878 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.220012 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.220116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.220367 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.220516 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.220660 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.220765 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.221001 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.221142 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.221325 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.221479 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.221632 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.221727 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.222199 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.222341 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.222502 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.222595 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.222855 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.223011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.223170 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.223269 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.223507 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.223605 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.223823 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.223980 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.224139 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.224236 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.224454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.224551 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.224765 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.224916 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.225080 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.225189 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.225405 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.225509 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.225747 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.225854 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.226084 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.226180 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.226400 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.226498 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.226721 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.226819 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.227033 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.227129 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.227349 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.227445 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.227667 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.227770 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.227977 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.228072 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.228293 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.228388 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.228609 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.228713 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.228921 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.229018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.229233 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.229339 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.229572 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.229671 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.229879 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.229985 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.230197 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.230300 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.230512 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.230605 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.230825 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.230919 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.231141 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.231244 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.231453 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.231559 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.231770 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.231861 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.232086 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.232190 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.232408 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.232549 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.232720 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.232856 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.233030 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.233163 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.233388 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.233483 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.233749 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.233846 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.234074 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.234171 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.234392 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.234485 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.234719 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.234810 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.235040 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.235134 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.235369 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.235468 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.235686 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.235787 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.236003 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.236094 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.236320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.236421 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.236658 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.236767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.237005 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.237202 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.237342 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.237565 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.237699 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.237975 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.238070 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.238308 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.238400 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.238624 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.238724 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.238941 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.239035 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.239260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.239351 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.239575 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.239680 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.239885 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.239983 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.240194 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.240294 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.240512 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.240613 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.240824 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.240923 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.241134 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.241227 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.241444 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.241589 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.241823 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.241918 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.242143 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.242247 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.242450 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.242549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.242762 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.242859 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.243070 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.243169 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.243379 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.243480 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.243688 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.243781 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.243998 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.244093 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.244314 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.244414 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.244621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.244714 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.244938 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.245030 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.245245 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.245338 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.245581 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.245676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.245885 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.245989 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.246223 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.246360 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.246539 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.246674 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.246858 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.246968 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.247186 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.247291 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.247508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.247600 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.247835 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.247946 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.248150 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.248247 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.248477 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.248570 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.248805 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.248898 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.249128 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.249220 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.249449 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.249540 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.249912 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.250040 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.250193 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.250303 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.250520 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.250610 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.250838 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.250930 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.251154 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.251245 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.251473 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.251579 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.251792 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.251884 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.252124 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.252218 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.252455 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.252557 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.252769 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.252869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.253093 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.253193 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.253409 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.253512 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.253751 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.253858 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.254074 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.254166 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.254393 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.254494 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.254712 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.254803 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.255026 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.255126 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.255343 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.255442 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.255667 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.255760 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.255984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.256075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.256296 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.256428 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.256613 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.256706 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.256927 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.257023 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.257269 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.257369 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.257603 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.257699 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.257917 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.258028 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.258242 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.258378 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.258575 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.258703 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.258920 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.259030 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.259230 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.259324 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.259551 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.259652 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.259862 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.259964 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.260175 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.260275 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.260485 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.260578 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.260797 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.260903 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.261046 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 17:39:12.261137 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.261433 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.261799 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.262124 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.262455 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.262776 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.263107 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.263424 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.263754 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.264091 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.264414 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.264728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.265068 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.265386 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.265730 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.266051 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.266369 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.266688 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.267004 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.267337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.267671 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.267989 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.268324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.268650 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.268981 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.269305 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.269647 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.269989 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.270312 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.270631 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.270955 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.271352 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.271588 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.271913 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.272237 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.272573 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.272995 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.273319 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.273678 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.274022 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.274381 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.274706 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.275056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.275391 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.275714 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.276030 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.276344 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 17:39:12.276605 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 17:39:12.284660 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_db.sqlalchemy.engines [None req-eb677be6-cbab-4f2c-b3d9-aa934c26d3d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 17:39:12.300082 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_db.sqlalchemy.engines [None req-b67ca92d-94ea-4350-9331-bdebafd82cce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 17:39:12.349534 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.context [None req-eb677be6-cbab-4f2c-b3d9-aa934c26d3d6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e1c4446-23c6-4b82-8040-1fc724b16042(cell1) {{(pid=128816) load_cells /opt/stack/nova/nova/context.py:464}} May 16 17:39:12.354016 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eb677be6-cbab-4f2c-b3d9-aa934c26d3d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:12.355598 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eb677be6-cbab-4f2c-b3d9-aa934c26d3d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:12.356538 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eb677be6-cbab-4f2c-b3d9-aa934c26d3d6 None None] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:12.358539 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eb677be6-cbab-4f2c-b3d9-aa934c26d3d6 None None] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:12.364673 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.context [None req-b67ca92d-94ea-4350-9331-bdebafd82cce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e1c4446-23c6-4b82-8040-1fc724b16042(cell1) {{(pid=128815) load_cells /opt/stack/nova/nova/context.py:464}} May 16 17:39:12.369202 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b67ca92d-94ea-4350-9331-bdebafd82cce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:12.370030 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_db.sqlalchemy.engines [None req-eb677be6-cbab-4f2c-b3d9-aa934c26d3d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 17:39:12.370840 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b67ca92d-94ea-4350-9331-bdebafd82cce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:12.371803 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b67ca92d-94ea-4350-9331-bdebafd82cce None None] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:12.373305 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_db.sqlalchemy.engines [None req-eb677be6-cbab-4f2c-b3d9-aa934c26d3d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 17:39:12.373723 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b67ca92d-94ea-4350-9331-bdebafd82cce None None] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:12.384914 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_db.sqlalchemy.engines [None req-b67ca92d-94ea-4350-9331-bdebafd82cce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 17:39:12.386762 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_db.sqlalchemy.engines [None req-b67ca92d-94ea-4350-9331-bdebafd82cce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 17:39:12.530134 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_db.sqlalchemy.engines [None req-eb677be6-cbab-4f2c-b3d9-aa934c26d3d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 17:39:12.544977 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_db.sqlalchemy.engines [None req-b67ca92d-94ea-4350-9331-bdebafd82cce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 17:39:12.852009 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: WARNING keystonemiddleware.auth_token [None req-eb677be6-cbab-4f2c-b3d9-aa934c26d3d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 17:39:12.859586 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: WARNING keystonemiddleware.auth_token [None req-eb677be6-cbab-4f2c-b3d9-aa934c26d3d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 17:39:12.868056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: WARNING keystonemiddleware.auth_token [None req-b67ca92d-94ea-4350-9331-bdebafd82cce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 17:39:12.875802 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: WARNING keystonemiddleware.auth_token [None req-b67ca92d-94ea-4350-9331-bdebafd82cce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 17:39:13.205042 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: WARNING keystonemiddleware.auth_token [None req-eb677be6-cbab-4f2c-b3d9-aa934c26d3d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 17:39:13.212452 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: WARNING keystonemiddleware.auth_token [None req-eb677be6-cbab-4f2c-b3d9-aa934c26d3d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 17:39:13.217756 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563c793b09c0 pid: 128816 (default app) May 16 17:39:13.224591 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: WARNING keystonemiddleware.auth_token [None req-b67ca92d-94ea-4350-9331-bdebafd82cce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 17:39:13.230943 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: WARNING keystonemiddleware.auth_token [None req-b67ca92d-94ea-4350-9331-bdebafd82cce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 17:39:13.236355 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563c793b09c0 pid: 128815 (default app) May 16 17:39:53.775920 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-23e7dfcf-d6e5-49f6-93cb-4534cbef4416 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] Action: 'create', calling method: .version_select at 0x7f79a6972280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1607000319", "metadata": {"Type": "work"}}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-23e7dfcf-d6e5-49f6-93cb-4534cbef4416 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] Request method failure captured: May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 122 May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigoxo-PND0d-yQv5o_2XfTRXCNYtMYydzVicplyJ262Zz9Q7L7c3Z-R8-4gV_hGf78cZ-4-311hWX0O0BXeXcwm7l8AXDCxZqgwGS23Fk8YaB_wl6XmlL14wSLAvHhKDdRvS88BYttcCrrDThuNiG0PM_wFrRYxjwc8aw2gxw0cDe4OQ May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: c4c1d398e6214fec98dbd4baf7e7e560 May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-VolumesNegativeTest-317922427 May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:39:53.792021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:39:53.794762 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4c1d398e6214fec98dbd4baf7e7e560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c4c1d398e6214fec98dbd4baf7e7e560", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c4c1d398e6214fec98dbd4baf7e7e560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4c1d398e6214fec98dbd4baf7e7e560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:39:53.794762 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-VolumesNegativeTest-317922427 May 16 17:39:53.794762 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: c4c1d398e6214fec98dbd4baf7e7e560 May 16 17:39:53.794762 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-VolumesNegativeTest-317922427 May 16 17:39:53.794762 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-VolumesNegativeTest-317922427-project May 16 17:39:53.794762 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:39:53.794762 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:39:53.794762 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 8ae5a7cc098f4a9f98d5e09a2095e95d May 16 17:39:53.794762 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-VolumesNegativeTest-317922427-project May 16 17:39:53.794762 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: May 16 17:39:53.794762 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1607000319", "metadata": {"Type": "work"}}} May 16 17:39:53.794762 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: May 16 17:39:53.794762 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1607000319', 'metadata': {'Type': 'work'}}}} May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise error May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi '#$%' May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:39:53.795726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 17:39:53.798400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 17:39:53.799851 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 17:39:53.799851 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:39:53.799851 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-23e7dfcf-d6e5-49f6-93cb-4534cbef4416 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:39:53.799851 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-23e7dfcf-d6e5-49f6-93cb-4534cbef4416 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.833167 May 16 17:39:53.799851 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1155 bytes} [Mon May 16 17:39:52 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 835 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 17:39:54.014538 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4ea8844d-5e61-4976-9048-faad7922d6b0 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] Action: 'create', calling method: .version_select at 0x7f79a699dee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1450144682", "metadata": {"Type": "work"}}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4ea8844d-5e61-4976-9048-faad7922d6b0 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] Request method failure captured: May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 120 May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigoxo-PND0d-yQv5o_2XfTRXCNYtMYydzVicplyJ262Zz9Q7L7c3Z-R8-4gV_hGf78cZ-4-311hWX0O0BXeXcwm7l8AXDCxZqgwGS23Fk8YaB_wl6XmlL14wSLAvHhKDdRvS88BYttcCrrDThuNiG0PM_wFrRYxjwc8aw2gxw0cDe4OQ May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: c4c1d398e6214fec98dbd4baf7e7e560 May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-VolumesNegativeTest-317922427 May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:39:54.018775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:39:54.020212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4c1d398e6214fec98dbd4baf7e7e560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c4c1d398e6214fec98dbd4baf7e7e560", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c4c1d398e6214fec98dbd4baf7e7e560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4c1d398e6214fec98dbd4baf7e7e560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:39:54.020212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-VolumesNegativeTest-317922427 May 16 17:39:54.020212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: c4c1d398e6214fec98dbd4baf7e7e560 May 16 17:39:54.020212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-VolumesNegativeTest-317922427 May 16 17:39:54.020212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-VolumesNegativeTest-317922427-project May 16 17:39:54.020212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:39:54.020212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:39:54.020212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: 8ae5a7cc098f4a9f98d5e09a2095e95d May 16 17:39:54.020212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-VolumesNegativeTest-317922427-project May 16 17:39:54.020212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: May 16 17:39:54.020212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1450144682", "metadata": {"Type": "work"}}} May 16 17:39:54.020212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: May 16 17:39:54.020212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1450144682', 'metadata': {'Type': 'work'}}}} May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise error May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi '0' May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:39:54.021075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 17:39:54.024366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 17:39:54.026018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 17:39:54.026018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:54.026018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4ea8844d-5e61-4976-9048-faad7922d6b0 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:39:54.026018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-4ea8844d-5e61-4976-9048-faad7922d6b0 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.216376 May 16 17:39:54.026018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 1/2] 10.222.0.58 () {60 vars in 1155 bytes} [Mon May 16 17:39:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 218 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 17:39:54.030125 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-df9d6456-e65c-4098-923d-b488dbb4a2c3 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] Action: 'create', calling method: .version_select at 0x7f79a68095e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1497179489", "metadata": {"Type": "work"}}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-df9d6456-e65c-4098-923d-b488dbb4a2c3 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] Request method failure captured: May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 119 May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigoxo-PND0d-yQv5o_2XfTRXCNYtMYydzVicplyJ262Zz9Q7L7c3Z-R8-4gV_hGf78cZ-4-311hWX0O0BXeXcwm7l8AXDCxZqgwGS23Fk8YaB_wl6XmlL14wSLAvHhKDdRvS88BYttcCrrDThuNiG0PM_wFrRYxjwc8aw2gxw0cDe4OQ May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: c4c1d398e6214fec98dbd4baf7e7e560 May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-VolumesNegativeTest-317922427 May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:39:54.033135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:39:54.034779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4c1d398e6214fec98dbd4baf7e7e560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c4c1d398e6214fec98dbd4baf7e7e560", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c4c1d398e6214fec98dbd4baf7e7e560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4c1d398e6214fec98dbd4baf7e7e560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:39:54.034779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-VolumesNegativeTest-317922427 May 16 17:39:54.034779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: c4c1d398e6214fec98dbd4baf7e7e560 May 16 17:39:54.034779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-VolumesNegativeTest-317922427 May 16 17:39:54.034779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-VolumesNegativeTest-317922427-project May 16 17:39:54.034779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:39:54.034779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:39:54.034779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 8ae5a7cc098f4a9f98d5e09a2095e95d May 16 17:39:54.034779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-VolumesNegativeTest-317922427-project May 16 17:39:54.034779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: May 16 17:39:54.034779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1497179489", "metadata": {"Type": "work"}}} May 16 17:39:54.034779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: May 16 17:39:54.034779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1497179489', 'metadata': {'Type': 'work'}}}} May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise error May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi '' May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:39:54.035921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 17:39:54.039345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 17:39:54.040705 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 17:39:54.040705 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:39:54.040705 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-df9d6456-e65c-4098-923d-b488dbb4a2c3 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:39:54.040705 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-df9d6456-e65c-4098-923d-b488dbb4a2c3 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008330 May 16 17:39:54.040705 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 2/3] 10.222.0.58 () {60 vars in 1155 bytes} [Mon May 16 17:39:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 17:39:54.044081 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-cb3dc377-1d81-445c-a524-90a012b9641b tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] Calling method '.version_select at 0x7f79a685d1f0>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:55.067813 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-5547ad42-9329-4230-b341-517c6337d86c tempest-VolumesGetTestJSON-285041317 tempest-VolumesGetTestJSON-285041317-project] Action: 'create', calling method: .version_select at 0x7f79a6972670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-432621204", "metadata": {"Type": "work"}}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:39:55.590023 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-cb3dc377-1d81-445c-a524-90a012b9641b tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] HTTP exception thrown: Volume tempest-invalid-308127970 could not be found. May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-cb3dc377-1d81-445c-a524-90a012b9641b tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] Request method failure captured: May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-308127970 HTTP/1.1 May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigoxo-PND0d-yQv5o_2XfTRXCNYtMYydzVicplyJ262Zz9Q7L7c3Z-R8-4gV_hGf78cZ-4-311hWX0O0BXeXcwm7l8AXDCxZqgwGS23Fk8YaB_wl6XmlL14wSLAvHhKDdRvS88BYttcCrrDThuNiG0PM_wFrRYxjwc8aw2gxw0cDe4OQ May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: c4c1d398e6214fec98dbd4baf7e7e560 May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-VolumesNegativeTest-317922427 May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:39:55.594568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:39:55.596018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4c1d398e6214fec98dbd4baf7e7e560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c4c1d398e6214fec98dbd4baf7e7e560", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c4c1d398e6214fec98dbd4baf7e7e560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4c1d398e6214fec98dbd4baf7e7e560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:39:55.596018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-VolumesNegativeTest-317922427 May 16 17:39:55.596018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: c4c1d398e6214fec98dbd4baf7e7e560 May 16 17:39:55.596018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-VolumesNegativeTest-317922427 May 16 17:39:55.596018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-VolumesNegativeTest-317922427-project May 16 17:39:55.596018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:39:55.596018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:39:55.596018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: 8ae5a7cc098f4a9f98d5e09a2095e95d May 16 17:39:55.596018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-VolumesNegativeTest-317922427-project May 16 17:39:55.596018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: May 16 17:39:55.596018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Volume tempest-invalid-308127970 could not be found. May 16 17:39:55.596018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': 'tempest-invalid-308127970'} May 16 17:39:55.596018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-308127970 could not be found. (HTTP 404) (Request-ID: req-579a316b-9513-4e36-bbbf-268e9547570d) May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:55.596869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:39:55.598120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-308127970 could not be found. May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:39:55.599380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-308127970 could not be found. May 16 17:39:55.600849 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:55.600849 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:55.600849 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:55.600849 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:55.600849 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:55.600849 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:55.600849 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:39:55.600849 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:39:55.600849 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-308127970 could not be found. May 16 17:39:55.600849 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:55.602360 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-cb3dc377-1d81-445c-a524-90a012b9641b tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] Returning 404 to user: Volume tempest-invalid-308127970 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:39:55.603556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-cb3dc377-1d81-445c-a524-90a012b9641b tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-308127970" status: 404 len: 98 microversion: 2.1 time: 1.563182 May 16 17:39:55.604634 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1214 bytes} [Mon May 16 17:39:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-308127970 => generated 98 bytes in 1565 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 16 17:39:56.034295 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-70edbb54-e9a3-4dbc-a646-09aef7be708a tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Action: 'create', calling method: .version_select at 0x7f79a690fca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1516197962"}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:39:57.103918 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-5547ad42-9329-4230-b341-517c6337d86c tempest-VolumesGetTestJSON-285041317 tempest-VolumesGetTestJSON-285041317-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.397076 May 16 17:39:57.104624 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 3/5] 10.222.0.58 () {60 vars in 1155 bytes} [Mon May 16 17:39:54 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2399 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 16 17:39:57.110358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-60493ff6-2d8c-457f-832e-a424f32cd824 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004487 May 16 17:39:57.110892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 4/6] 10.222.0.58 () {58 vars in 1139 bytes} [Mon May 16 17:39:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 16 17:39:57.287002 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-70edbb54-e9a3-4dbc-a646-09aef7be708a tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.677669 May 16 17:39:57.288574 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 3/7] 10.222.0.58 () {60 vars in 1154 bytes} [Mon May 16 17:39:55 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1683 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 16 17:39:57.295350 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-5be60611-9f92-4daf-89e2-015050d418d3 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005028 May 16 17:39:57.296861 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1136 bytes} [Mon May 16 17:39:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 16 17:39:57.308339 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f23cb101-15f6-4489-b2d2-9609d69eb169 tempest-VolumesGetTestJSON-285041317 tempest-VolumesGetTestJSON-285041317-project] Calling method '.version_select at 0x7f79a674b5e0>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:57.316720 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c3396033-931d-4006-957f-7694f4a8dd75 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-44535431", "imageRef": "782bd628-ef1b-419c-99f5-2c312d1766a6", "flavorRef": "452", "networks": [{"uuid": "9c74171c-f2c1-4ab1-97c4-b6c0561d4aeb"}]}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:39:57.478964 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f23cb101-15f6-4489-b2d2-9609d69eb169 tempest-VolumesGetTestJSON-285041317 tempest-VolumesGetTestJSON-285041317-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9f41039e-246e-4426-a7d0-30ff800e55c8" status: 200 len: 352 microversion: 2.1 time: 0.180195 May 16 17:39:57.479734 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 5/9] 10.222.0.58 () {58 vars in 1244 bytes} [Mon May 16 17:39:57 2022] GET /compute/v2.1/os-volumes/9f41039e-246e-4426-a7d0-30ff800e55c8 => generated 352 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:39:57.484608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-63e23aa5-afdc-4d13-800b-a7adf8bc9d80 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Calling method '.version_select at 0x7f79a674bd30>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:57.536809 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.network.neutron [None req-c3396033-931d-4006-957f-7694f4a8dd75 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] validate_networks() for [('9c74171c-f2c1-4ab1-97c4-b6c0561d4aeb', None, None, None, None, None)] {{(pid=128816) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:39:57.649649 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-63e23aa5-afdc-4d13-800b-a7adf8bc9d80 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/05ae0773-ba16-403c-b356-973b1bc65956" status: 200 len: 345 microversion: 2.1 time: 0.168164 May 16 17:39:57.659070 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 6/10] 10.222.0.58 () {58 vars in 1244 bytes} [Mon May 16 17:39:57 2022] GET /compute/v2.1/os-volumes/05ae0773-ba16-403c-b356-973b1bc65956 => generated 345 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:39:57.659070 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8acea203-0313-45f6-b70f-91c82bdce30b tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] Calling method '.version_select at 0x7f79a674e430>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:57.719068 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-8acea203-0313-45f6-b70f-91c82bdce30b tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] HTTP exception thrown: Volume 4ccd97c1-5766-4c5b-bdd3-0e71f871de7d could not be found. May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8acea203-0313-45f6-b70f-91c82bdce30b tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] Request method failure captured: May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: DELETE /compute/v2.1/os-volumes/4ccd97c1-5766-4c5b-bdd3-0e71f871de7d HTTP/1.1 May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigoxo-PND0d-yQv5o_2XfTRXCNYtMYydzVicplyJ262Zz9Q7L7c3Z-R8-4gV_hGf78cZ-4-311hWX0O0BXeXcwm7l8AXDCxZqgwGS23Fk8YaB_wl6XmlL14wSLAvHhKDdRvS88BYttcCrrDThuNiG0PM_wFrRYxjwc8aw2gxw0cDe4OQ May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: c4c1d398e6214fec98dbd4baf7e7e560 May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-VolumesNegativeTest-317922427 May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:39:57.721361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:39:57.722726 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4c1d398e6214fec98dbd4baf7e7e560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c4c1d398e6214fec98dbd4baf7e7e560", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c4c1d398e6214fec98dbd4baf7e7e560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4c1d398e6214fec98dbd4baf7e7e560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:39:57.722726 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-VolumesNegativeTest-317922427 May 16 17:39:57.722726 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: c4c1d398e6214fec98dbd4baf7e7e560 May 16 17:39:57.722726 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-VolumesNegativeTest-317922427 May 16 17:39:57.722726 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-VolumesNegativeTest-317922427-project May 16 17:39:57.722726 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:39:57.722726 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:39:57.722726 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: 8ae5a7cc098f4a9f98d5e09a2095e95d May 16 17:39:57.722726 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-VolumesNegativeTest-317922427-project May 16 17:39:57.722726 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: May 16 17:39:57.722726 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Volume 4ccd97c1-5766-4c5b-bdd3-0e71f871de7d could not be found. May 16 17:39:57.722726 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': '4ccd97c1-5766-4c5b-bdd3-0e71f871de7d'} May 16 17:39:57.722726 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4ccd97c1-5766-4c5b-bdd3-0e71f871de7d could not be found. (HTTP 404) (Request-ID: req-3ac35867-f8a6-41c7-af19-388902fc7f58) May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:57.723556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:39:57.724767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4ccd97c1-5766-4c5b-bdd3-0e71f871de7d could not be found. May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 17:39:57.726011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:39:57.727982 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4ccd97c1-5766-4c5b-bdd3-0e71f871de7d could not be found. May 16 17:39:57.727982 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:57.727982 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:57.727982 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:57.727982 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:57.727982 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:57.727982 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:57.727982 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:39:57.727982 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:39:57.727982 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4ccd97c1-5766-4c5b-bdd3-0e71f871de7d could not be found. May 16 17:39:57.727982 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:57.730189 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8acea203-0313-45f6-b70f-91c82bdce30b tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] Returning 404 to user: Volume 4ccd97c1-5766-4c5b-bdd3-0e71f871de7d could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:39:57.731261 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-8acea203-0313-45f6-b70f-91c82bdce30b tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/4ccd97c1-5766-4c5b-bdd3-0e71f871de7d" status: 404 len: 109 microversion: 2.1 time: 0.079219 May 16 17:39:57.733003 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 7/11] 10.222.0.58 () {58 vars in 1247 bytes} [Mon May 16 17:39:57 2022] DELETE /compute/v2.1/os-volumes/4ccd97c1-5766-4c5b-bdd3-0e71f871de7d => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:39:57.743043 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5157199f-d883-49ff-9e42-3d42c7fcde87 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] Calling method '.version_select at 0x7f79a674bdc0>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:57.787878 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-5157199f-d883-49ff-9e42-3d42c7fcde87 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] HTTP exception thrown: Volume 710e99df-04db-4f58-87f3-b35382bc7b70 could not be found. May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5157199f-d883-49ff-9e42-3d42c7fcde87 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] Request method failure captured: May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/os-volumes/710e99df-04db-4f58-87f3-b35382bc7b70 HTTP/1.1 May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigoxo-PND0d-yQv5o_2XfTRXCNYtMYydzVicplyJ262Zz9Q7L7c3Z-R8-4gV_hGf78cZ-4-311hWX0O0BXeXcwm7l8AXDCxZqgwGS23Fk8YaB_wl6XmlL14wSLAvHhKDdRvS88BYttcCrrDThuNiG0PM_wFrRYxjwc8aw2gxw0cDe4OQ May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: c4c1d398e6214fec98dbd4baf7e7e560 May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-VolumesNegativeTest-317922427 May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:39:57.791438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:39:57.793286 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4c1d398e6214fec98dbd4baf7e7e560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c4c1d398e6214fec98dbd4baf7e7e560", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c4c1d398e6214fec98dbd4baf7e7e560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4c1d398e6214fec98dbd4baf7e7e560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:39:57.793286 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-VolumesNegativeTest-317922427 May 16 17:39:57.793286 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: c4c1d398e6214fec98dbd4baf7e7e560 May 16 17:39:57.793286 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-VolumesNegativeTest-317922427 May 16 17:39:57.793286 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-VolumesNegativeTest-317922427-project May 16 17:39:57.793286 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:39:57.793286 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:39:57.793286 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: 8ae5a7cc098f4a9f98d5e09a2095e95d May 16 17:39:57.793286 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-VolumesNegativeTest-317922427-project May 16 17:39:57.793286 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: May 16 17:39:57.793286 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Volume 710e99df-04db-4f58-87f3-b35382bc7b70 could not be found. May 16 17:39:57.793286 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': '710e99df-04db-4f58-87f3-b35382bc7b70'} May 16 17:39:57.793286 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 710e99df-04db-4f58-87f3-b35382bc7b70 could not be found. (HTTP 404) (Request-ID: req-2bbc7be9-f514-4fb1-9928-bab4ed296a0b) May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:57.794310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 17:39:57.796686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 710e99df-04db-4f58-87f3-b35382bc7b70 could not be found. May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 17:39:57.798114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:39:57.800526 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 710e99df-04db-4f58-87f3-b35382bc7b70 could not be found. May 16 17:39:57.800526 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:57.800526 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:57.800526 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:57.800526 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:57.800526 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:57.800526 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:57.800526 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:39:57.800526 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:39:57.800526 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 710e99df-04db-4f58-87f3-b35382bc7b70 could not be found. May 16 17:39:57.800526 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:57.800526 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5157199f-d883-49ff-9e42-3d42c7fcde87 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] Returning 404 to user: Volume 710e99df-04db-4f58-87f3-b35382bc7b70 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:39:57.802901 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-5157199f-d883-49ff-9e42-3d42c7fcde87 tempest-VolumesNegativeTest-317922427 tempest-VolumesNegativeTest-317922427-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/710e99df-04db-4f58-87f3-b35382bc7b70" status: 404 len: 109 microversion: 2.1 time: 0.063915 May 16 17:39:57.803436 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 8/12] 10.222.0.58 () {58 vars in 1244 bytes} [Mon May 16 17:39:57 2022] GET /compute/v2.1/os-volumes/710e99df-04db-4f58-87f3-b35382bc7b70 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:39:58.494571 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e7fe45f7-bd1f-4042-b33f-04d3fd156bdc tempest-VolumesGetTestJSON-285041317 tempest-VolumesGetTestJSON-285041317-project] Calling method '.version_select at 0x7f79a67a48b0>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:58.610143 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-e7fe45f7-bd1f-4042-b33f-04d3fd156bdc tempest-VolumesGetTestJSON-285041317 tempest-VolumesGetTestJSON-285041317-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9f41039e-246e-4426-a7d0-30ff800e55c8" status: 200 len: 353 microversion: 2.1 time: 0.121613 May 16 17:39:58.617434 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 9/13] 10.222.0.58 () {58 vars in 1244 bytes} [Mon May 16 17:39:58 2022] GET /compute/v2.1/os-volumes/9f41039e-246e-4426-a7d0-30ff800e55c8 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:39:58.625104 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-6a8bc39a-7aef-4817-b3b9-fe1fd2f67b62 tempest-VolumesGetTestJSON-285041317 tempest-VolumesGetTestJSON-285041317-project] Calling method '.version_select at 0x7f79a674b940>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:58.695492 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-6a8bc39a-7aef-4817-b3b9-fe1fd2f67b62 tempest-VolumesGetTestJSON-285041317 tempest-VolumesGetTestJSON-285041317-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9f41039e-246e-4426-a7d0-30ff800e55c8" status: 200 len: 353 microversion: 2.1 time: 0.075218 May 16 17:39:58.708763 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 10/14] 10.222.0.58 () {58 vars in 1244 bytes} [Mon May 16 17:39:58 2022] GET /compute/v2.1/os-volumes/9f41039e-246e-4426-a7d0-30ff800e55c8 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:39:58.722276 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-87bb42e5-fc89-40ff-b8cc-cf4c3d0f5b68 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Calling method '.version_select at 0x7f79a674b820>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:58.832095 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-87bb42e5-fc89-40ff-b8cc-cf4c3d0f5b68 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/05ae0773-ba16-403c-b356-973b1bc65956" status: 200 len: 346 microversion: 2.1 time: 0.120607 May 16 17:39:58.834636 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 11/15] 10.222.0.58 () {58 vars in 1244 bytes} [Mon May 16 17:39:58 2022] GET /compute/v2.1/os-volumes/05ae0773-ba16-403c-b356-973b1bc65956 => generated 346 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:39:58.840683 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f3afc8ba-57a6-43d4-9bbf-1f85b2c047a6 tempest-VolumesGetTestJSON-285041317 tempest-VolumesGetTestJSON-285041317-project] Calling method '.version_select at 0x7f79a690fca0>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:58.978791 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f3afc8ba-57a6-43d4-9bbf-1f85b2c047a6 tempest-VolumesGetTestJSON-285041317 tempest-VolumesGetTestJSON-285041317-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/9f41039e-246e-4426-a7d0-30ff800e55c8" status: 202 len: 0 microversion: 2.1 time: 0.143001 May 16 17:39:58.979614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 12/16] 10.222.0.58 () {58 vars in 1247 bytes} [Mon May 16 17:39:58 2022] DELETE /compute/v2.1/os-volumes/9f41039e-246e-4426-a7d0-30ff800e55c8 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:39:58.984634 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-a2fbe93f-da88-43b7-8b6d-a84f527f6807 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Action: 'create', calling method: .version_select at 0x7f79a674e310>, body: {"snapshot": {"volume_id": "05ae0773-ba16-403c-b356-973b1bc65956", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-310256254"}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:39:59.292520 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-a2fbe93f-da88-43b7-8b6d-a84f527f6807 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.311597 May 16 17:39:59.299071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 13/17] 10.222.0.58 () {60 vars in 1161 bytes} [Mon May 16 17:39:58 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:39:59.315401 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f841ef8b-6935-42cf-aaed-a1fc26360e4f tempest-VolumesGetTestJSON-285041317 tempest-VolumesGetTestJSON-285041317-project] Calling method '.version_select at 0x7f79a674b700>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:59.396417 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-f841ef8b-6935-42cf-aaed-a1fc26360e4f tempest-VolumesGetTestJSON-285041317 tempest-VolumesGetTestJSON-285041317-project] HTTP exception thrown: Volume 9f41039e-246e-4426-a7d0-30ff800e55c8 could not be found. May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f841ef8b-6935-42cf-aaed-a1fc26360e4f tempest-VolumesGetTestJSON-285041317 tempest-VolumesGetTestJSON-285041317-project] Request method failure captured: May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/os-volumes/9f41039e-246e-4426-a7d0-30ff800e55c8 HTTP/1.1 May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigoxqS9JDafnkM5BqqaqefUWml_F489Y4VFPZYcFnZoxyioBmqX7whlzVTqVXfQrPAZJMmtwZ_tDFg0AAkhe-2h7uwoNarymNDRuRlyNRdlo63A_hv7THGIlidw1hGwt5bD1YMKMjZ0Zi_FcHhAcjvZ8snWs5ZPeJhF-tszODErkuLMY May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 856203f959084015950211c4e61f8cbf May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-VolumesGetTestJSON-285041317 May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:39:59.399332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:39:59.401032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/856203f959084015950211c4e61f8cbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_856203f959084015950211c4e61f8cbf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/856203f959084015950211c4e61f8cbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/856203f959084015950211c4e61f8cbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:39:59.401032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-VolumesGetTestJSON-285041317 May 16 17:39:59.401032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 856203f959084015950211c4e61f8cbf May 16 17:39:59.401032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-VolumesGetTestJSON-285041317 May 16 17:39:59.401032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-VolumesGetTestJSON-285041317-project May 16 17:39:59.401032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:39:59.401032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:39:59.401032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: 93f22220c9f144ef92b0cd0bf90c23df May 16 17:39:59.401032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-VolumesGetTestJSON-285041317-project May 16 17:39:59.401032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: May 16 17:39:59.401032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Volume 9f41039e-246e-4426-a7d0-30ff800e55c8 could not be found. May 16 17:39:59.401032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': '9f41039e-246e-4426-a7d0-30ff800e55c8'} May 16 17:39:59.401032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9f41039e-246e-4426-a7d0-30ff800e55c8 could not be found. (HTTP 404) (Request-ID: req-e75d827d-6a31-4112-bb05-5f44f9da2dd6) May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:59.402056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 17:39:59.404215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9f41039e-246e-4426-a7d0-30ff800e55c8 could not be found. May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 17:39:59.405761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:39:59.407131 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9f41039e-246e-4426-a7d0-30ff800e55c8 could not be found. May 16 17:39:59.407131 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:59.407131 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:39:59.407131 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:59.407131 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:39:59.407131 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:39:59.407131 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:39:59.407131 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:39:59.407131 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:39:59.407131 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9f41039e-246e-4426-a7d0-30ff800e55c8 could not be found. May 16 17:39:59.407131 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:39:59.407131 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f841ef8b-6935-42cf-aaed-a1fc26360e4f tempest-VolumesGetTestJSON-285041317 tempest-VolumesGetTestJSON-285041317-project] Returning 404 to user: Volume 9f41039e-246e-4426-a7d0-30ff800e55c8 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:39:59.407131 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f841ef8b-6935-42cf-aaed-a1fc26360e4f tempest-VolumesGetTestJSON-285041317 tempest-VolumesGetTestJSON-285041317-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9f41039e-246e-4426-a7d0-30ff800e55c8" status: 404 len: 109 microversion: 2.1 time: 0.098360 May 16 17:39:59.407131 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 14/18] 10.222.0.58 () {58 vars in 1244 bytes} [Mon May 16 17:39:59 2022] GET /compute/v2.1/os-volumes/9f41039e-246e-4426-a7d0-30ff800e55c8 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:39:59.412758 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d5a51aeb-f052-46fe-a56b-24f84b77ffd6 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Calling method '.version_select at 0x7f79a67a4d30>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:59.431321 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-c3396033-931d-4006-957f-7694f4a8dd75 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Flavor limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:39:59.432074 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-c3396033-931d-4006-957f-7694f4a8dd75 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Image limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:39:59.432660 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-c3396033-931d-4006-957f-7694f4a8dd75 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Flavor pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:39:59.433238 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-c3396033-931d-4006-957f-7694f4a8dd75 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Image pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:39:59.434204 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-c3396033-931d-4006-957f-7694f4a8dd75 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:39:59.522567 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c3396033-931d-4006-957f-7694f4a8dd75 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:59.526282 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c3396033-931d-4006-957f-7694f4a8dd75 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:59.528244 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c3396033-931d-4006-957f-7694f4a8dd75 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:39:59.530448 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d5a51aeb-f052-46fe-a56b-24f84b77ffd6 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/0055d9f5-d9bf-4b9c-956d-13283d474181" status: 200 len: 286 microversion: 2.1 time: 0.127431 May 16 17:39:59.532128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 15/19] 10.222.0.58 () {58 vars in 1250 bytes} [Mon May 16 17:39:59 2022] GET /compute/v2.1/os-snapshots/0055d9f5-d9bf-4b9c-956d-13283d474181 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:39:59.539654 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c3396033-931d-4006-957f-7694f4a8dd75 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:39:59.545806 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-fad36c72-148c-4468-ab7d-6a58b9f79f3c tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Calling method '.version_select at 0x7f79a674b160>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:59.633894 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-c3396033-931d-4006-957f-7694f4a8dd75 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Getting quotas for project 954fb79bc14043c5a136989ab363e7fd. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:39:59.652345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-fad36c72-148c-4468-ab7d-6a58b9f79f3c tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.111358 May 16 17:39:59.653172 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 16/20] 10.222.0.58 () {58 vars in 1139 bytes} [Mon May 16 17:39:59 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:39:59.658840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-c3396033-931d-4006-957f-7694f4a8dd75 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Getting quotas for user 565fbf46701f48b383d24614caf7b576 and project 954fb79bc14043c5a136989ab363e7fd. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:39:59.666786 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-bd725c9f-f251-409f-a7b5-c064d3ba3beb tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Calling method '.version_select at 0x7f79a674bee0>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:59.723903 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-c3396033-931d-4006-957f-7694f4a8dd75 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Going to run 1 instances... {{(pid=128816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:39:59.738181 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-c3396033-931d-4006-957f-7694f4a8dd75 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='782bd628-ef1b-419c-99f5-2c312d1766a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:39:59.768044 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-bd725c9f-f251-409f-a7b5-c064d3ba3beb tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/0055d9f5-d9bf-4b9c-956d-13283d474181" status: 200 len: 286 microversion: 2.1 time: 0.106284 May 16 17:39:59.769104 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 17/21] 10.222.0.58 () {58 vars in 1250 bytes} [Mon May 16 17:39:59 2022] GET /compute/v2.1/os-snapshots/0055d9f5-d9bf-4b9c-956d-13283d474181 => generated 286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:39:59.952065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-c3396033-931d-4006-957f-7694f4a8dd75 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.835641 May 16 17:39:59.958055 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 5/22] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:39:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:39:59.965605 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-2cc02105-0281-4977-b0aa-66ca26fc2685 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:39:59.966548 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-2cc02105-0281-4977-b0aa-66ca26fc2685 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:00.180944 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-2cc02105-0281-4977-b0aa-66ca26fc2685 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:00.210820 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-2cc02105-0281-4977-b0aa-66ca26fc2685 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1213 microversion: 2.1 time: 0.248617 May 16 17:40:00.223435 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 18/23] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:39:59 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1213 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:00.780267 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-91cafad2-37ec-4fab-85f5-aeabc318fd70 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Calling method '.version_select at 0x7f79a5e953a0>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:00.958412 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-91cafad2-37ec-4fab-85f5-aeabc318fd70 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/0055d9f5-d9bf-4b9c-956d-13283d474181" status: 200 len: 286 microversion: 2.1 time: 0.181694 May 16 17:40:00.959355 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 6/24] 10.222.0.58 () {58 vars in 1250 bytes} [Mon May 16 17:40:00 2022] GET /compute/v2.1/os-snapshots/0055d9f5-d9bf-4b9c-956d-13283d474181 => generated 286 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:01.228369 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0041b17b-4f7b-48c6-a4db-d2a2bc59bbc5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:01.229159 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-0041b17b-4f7b-48c6-a4db-d2a2bc59bbc5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:01.371036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-0041b17b-4f7b-48c6-a4db-d2a2bc59bbc5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:01.381072 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-0041b17b-4f7b-48c6-a4db-d2a2bc59bbc5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1213 microversion: 2.1 time: 0.156593 May 16 17:40:01.382383 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 19/25] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:01 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1213 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:01.970790 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ae185262-de5d-4650-852f-20b3ec433374 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Calling method '.version_select at 0x7f79a5e95af0>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:02.025093 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ae185262-de5d-4650-852f-20b3ec433374 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/0055d9f5-d9bf-4b9c-956d-13283d474181" status: 200 len: 286 microversion: 2.1 time: 0.058037 May 16 17:40:02.026402 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 7/26] 10.222.0.58 () {58 vars in 1250 bytes} [Mon May 16 17:40:01 2022] GET /compute/v2.1/os-snapshots/0055d9f5-d9bf-4b9c-956d-13283d474181 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:02.400327 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-df602dfa-867d-4544-a285-131c47111e70 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:02.400942 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-df602dfa-867d-4544-a285-131c47111e70 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:02.428652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-df602dfa-867d-4544-a285-131c47111e70 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:02.435886 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-df602dfa-867d-4544-a285-131c47111e70 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:02.436940 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-df602dfa-867d-4544-a285-131c47111e70 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:02.439774 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-df602dfa-867d-4544-a285-131c47111e70 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:02.990820 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-df602dfa-867d-4544-a285-131c47111e70 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:03.005855 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-df602dfa-867d-4544-a285-131c47111e70 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1217 microversion: 2.1 time: 0.609584 May 16 17:40:03.016249 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 20/27] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:02 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1217 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:03.038839 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-236f6a03-84bc-4a38-9c66-f9ed18870b75 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Calling method '.version_select at 0x7f79a5e95e50>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:03.111291 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-236f6a03-84bc-4a38-9c66-f9ed18870b75 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/0055d9f5-d9bf-4b9c-956d-13283d474181" status: 200 len: 287 microversion: 2.1 time: 0.077636 May 16 17:40:03.112325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 8/28] 10.222.0.58 () {58 vars in 1250 bytes} [Mon May 16 17:40:03 2022] GET /compute/v2.1/os-snapshots/0055d9f5-d9bf-4b9c-956d-13283d474181 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:40:03.122716 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-2f5ac2d9-9448-4376-9207-5afa00ffe36b tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Calling method '.version_select at 0x7f79a6682ee0>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:03.317671 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-2f5ac2d9-9448-4376-9207-5afa00ffe36b tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/0055d9f5-d9bf-4b9c-956d-13283d474181" status: 202 len: 0 microversion: 2.1 time: 0.198752 May 16 17:40:03.318349 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 21/29] 10.222.0.58 () {58 vars in 1253 bytes} [Mon May 16 17:40:03 2022] DELETE /compute/v2.1/os-snapshots/0055d9f5-d9bf-4b9c-956d-13283d474181 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:40:03.327029 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c1406b38-b688-4696-86eb-345b74f36141 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Calling method '.version_select at 0x7f79a5e95670>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:03.392294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-c1406b38-b688-4696-86eb-345b74f36141 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/0055d9f5-d9bf-4b9c-956d-13283d474181" status: 200 len: 286 microversion: 2.1 time: 0.068782 May 16 17:40:03.393580 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 9/30] 10.222.0.58 () {58 vars in 1250 bytes} [Mon May 16 17:40:03 2022] GET /compute/v2.1/os-snapshots/0055d9f5-d9bf-4b9c-956d-13283d474181 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:04.026852 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d91856a6-cffc-4580-be16-80e8582436fc tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:04.027615 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d91856a6-cffc-4580-be16-80e8582436fc tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:04.043308 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d91856a6-cffc-4580-be16-80e8582436fc tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:04.043801 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d91856a6-cffc-4580-be16-80e8582436fc tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:04.050727 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d91856a6-cffc-4580-be16-80e8582436fc tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:04.052749 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d91856a6-cffc-4580-be16-80e8582436fc tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:04.299090 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d91856a6-cffc-4580-be16-80e8582436fc tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:04.312590 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d91856a6-cffc-4580-be16-80e8582436fc tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1271 microversion: 2.1 time: 0.289601 May 16 17:40:04.320600 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 22/31] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:04 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1271 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:04.407063 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4abf1dca-00b8-4b98-8133-66be2de429a9 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Calling method '.version_select at 0x7f79a5e95ee0>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:04.474679 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-4abf1dca-00b8-4b98-8133-66be2de429a9 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] HTTP exception thrown: Snapshot 0055d9f5-d9bf-4b9c-956d-13283d474181 could not be found. May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4abf1dca-00b8-4b98-8133-66be2de429a9 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Request method failure captured: May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: GET /compute/v2.1/os-snapshots/0055d9f5-d9bf-4b9c-956d-13283d474181 HTTP/1.1 May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigoxqILdvq9A8X1wyZYZkptjWvjeNnSJbt_m6CzRxtUkVa8jlgFuPE2SUt7SkFJok35g8Vc7FW-yCaNTW8Z1nl2VIvY09ELIxrSPhJq3bUsuf5BEWa3RcckNHi3NB13RYwE7aSCLt87w_1tUpSe2IIPGk6J7bHU7mOpox8osRqxFl3zU May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 94fe0f6c2e964969bd46781356d2539e May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1424263552 May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:40:04.480003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:40:04.481320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/94fe0f6c2e964969bd46781356d2539e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_94fe0f6c2e964969bd46781356d2539e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/94fe0f6c2e964969bd46781356d2539e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/94fe0f6c2e964969bd46781356d2539e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:40:04.481320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1424263552 May 16 17:40:04.481320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 94fe0f6c2e964969bd46781356d2539e May 16 17:40:04.481320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1424263552 May 16 17:40:04.481320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-VolumesSnapshotsTestJSON-1424263552-project May 16 17:40:04.481320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:40:04.481320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:40:04.481320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 2b97874877694c3ea7cbc1af2a848b2a May 16 17:40:04.481320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1424263552-project May 16 17:40:04.481320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: May 16 17:40:04.481320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Snapshot 0055d9f5-d9bf-4b9c-956d-13283d474181 could not be found. May 16 17:40:04.481320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': '0055d9f5-d9bf-4b9c-956d-13283d474181'} May 16 17:40:04.481320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:40:04.482151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:40:04.482151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 16 17:40:04.482151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 16 17:40:04.482151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 16 17:40:04.482151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 16 17:40:04.482151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 16 17:40:04.482151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 16 17:40:04.482151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 17:40:04.482151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 17:40:04.482151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 17:40:04.482151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 17:40:04.482151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:40:04.482151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:40:04.482151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:40:04.482151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:40:04.482151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0055d9f5-d9bf-4b9c-956d-13283d474181 could not be found. (HTTP 404) (Request-ID: req-a6763ec4-41ac-4d59-bc6a-b6fa5f0cb293) May 16 17:40:04.482151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:04.482151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 17:40:04.483198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0055d9f5-d9bf-4b9c-956d-13283d474181 could not be found. May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 16 17:40:04.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:40:04.485354 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0055d9f5-d9bf-4b9c-956d-13283d474181 could not be found. May 16 17:40:04.485354 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:04.485354 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:40:04.485354 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:04.485354 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:40:04.485354 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:40:04.485354 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:40:04.485354 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:40:04.485354 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:40:04.485354 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0055d9f5-d9bf-4b9c-956d-13283d474181 could not be found. May 16 17:40:04.485354 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:04.485354 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4abf1dca-00b8-4b98-8133-66be2de429a9 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Returning 404 to user: Snapshot 0055d9f5-d9bf-4b9c-956d-13283d474181 could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:40:04.485354 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4abf1dca-00b8-4b98-8133-66be2de429a9 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/0055d9f5-d9bf-4b9c-956d-13283d474181" status: 404 len: 111 microversion: 2.1 time: 0.083241 May 16 17:40:04.488737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 10/32] 10.222.0.58 () {58 vars in 1250 bytes} [Mon May 16 17:40:04 2022] GET /compute/v2.1/os-snapshots/0055d9f5-d9bf-4b9c-956d-13283d474181 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:40:04.504475 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-20afbb4d-bb54-48d7-b746-ffa3dbb92746 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Calling method '.version_select at 0x7f79a669c820>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:04.729076 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-20afbb4d-bb54-48d7-b746-ffa3dbb92746 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/05ae0773-ba16-403c-b356-973b1bc65956" status: 202 len: 0 microversion: 2.1 time: 0.232385 May 16 17:40:04.730403 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 23/33] 10.222.0.58 () {58 vars in 1247 bytes} [Mon May 16 17:40:04 2022] DELETE /compute/v2.1/os-volumes/05ae0773-ba16-403c-b356-973b1bc65956 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:40:04.741270 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-af02fced-ed0f-4465-bd93-3dc245cfad67 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Calling method '.version_select at 0x7f79a5ea8820>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:04.850217 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-af02fced-ed0f-4465-bd93-3dc245cfad67 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/05ae0773-ba16-403c-b356-973b1bc65956" status: 200 len: 345 microversion: 2.1 time: 0.115287 May 16 17:40:04.851474 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 11/34] 10.222.0.58 () {58 vars in 1244 bytes} [Mon May 16 17:40:04 2022] GET /compute/v2.1/os-volumes/05ae0773-ba16-403c-b356-973b1bc65956 => generated 345 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:05.330073 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-06561faa-8999-496e-8d96-ca1d7228c10b tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:05.331378 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-06561faa-8999-496e-8d96-ca1d7228c10b tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:05.353459 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-06561faa-8999-496e-8d96-ca1d7228c10b tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:05.358276 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-06561faa-8999-496e-8d96-ca1d7228c10b tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:05.360188 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-06561faa-8999-496e-8d96-ca1d7228c10b tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:05.363521 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-06561faa-8999-496e-8d96-ca1d7228c10b tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:05.593986 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-06561faa-8999-496e-8d96-ca1d7228c10b tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:05.601508 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-06561faa-8999-496e-8d96-ca1d7228c10b tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1271 microversion: 2.1 time: 0.275658 May 16 17:40:05.611854 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 24/35] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:05 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1271 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:05.863794 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-23182c83-ce46-4bb7-a61d-b55655c7d4b3 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Calling method '.version_select at 0x7f79a5ea8f70>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:05.946983 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-23182c83-ce46-4bb7-a61d-b55655c7d4b3 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] HTTP exception thrown: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-23182c83-ce46-4bb7-a61d-b55655c7d4b3 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Request method failure captured: May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: GET /compute/v2.1/os-volumes/05ae0773-ba16-403c-b356-973b1bc65956 HTTP/1.1 May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigoxqILdvq9A8X1wyZYZkptjWvjeNnSJbt_m6CzRxtUkVa8jlgFuPE2SUt7SkFJok35g8Vc7FW-yCaNTW8Z1nl2VIvY09ELIxrSPhJq3bUsuf5BEWa3RcckNHi3NB13RYwE7aSCLt87w_1tUpSe2IIPGk6J7bHU7mOpox8osRqxFl3zU May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 94fe0f6c2e964969bd46781356d2539e May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1424263552 May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:40:05.949440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:40:05.951195 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/94fe0f6c2e964969bd46781356d2539e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_94fe0f6c2e964969bd46781356d2539e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/94fe0f6c2e964969bd46781356d2539e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/94fe0f6c2e964969bd46781356d2539e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:40:05.951195 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1424263552 May 16 17:40:05.951195 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 94fe0f6c2e964969bd46781356d2539e May 16 17:40:05.951195 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1424263552 May 16 17:40:05.951195 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-VolumesSnapshotsTestJSON-1424263552-project May 16 17:40:05.951195 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:40:05.951195 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:40:05.951195 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 2b97874877694c3ea7cbc1af2a848b2a May 16 17:40:05.951195 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1424263552-project May 16 17:40:05.951195 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: May 16 17:40:05.951195 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. May 16 17:40:05.951195 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': '05ae0773-ba16-403c-b356-973b1bc65956'} May 16 17:40:05.951195 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. (HTTP 404) (Request-ID: req-f2673592-77c6-4b66-ac66-7c47c4a2b729) May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:40:05.951818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 17:40:05.953018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 17:40:05.954276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:40:05.955157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. May 16 17:40:05.955157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:05.955157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:40:05.955157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:05.955157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:40:05.955157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:40:05.955157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:40:05.955157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:40:05.955157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:40:05.955157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. May 16 17:40:05.955157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:05.955157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-23182c83-ce46-4bb7-a61d-b55655c7d4b3 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Returning 404 to user: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:40:05.955157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-23182c83-ce46-4bb7-a61d-b55655c7d4b3 tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/05ae0773-ba16-403c-b356-973b1bc65956" status: 404 len: 109 microversion: 2.1 time: 0.091450 May 16 17:40:05.955157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 12/36] 10.222.0.58 () {58 vars in 1244 bytes} [Mon May 16 17:40:05 2022] GET /compute/v2.1/os-volumes/05ae0773-ba16-403c-b356-973b1bc65956 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:40:05.964666 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e6b278e1-1837-4187-862d-5bf228e6021a tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Calling method '.version_select at 0x7f79a669c9d0>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:06.033327 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-e6b278e1-1837-4187-862d-5bf228e6021a tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] HTTP exception thrown: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e6b278e1-1837-4187-862d-5bf228e6021a tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Request method failure captured: May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: DELETE /compute/v2.1/os-volumes/05ae0773-ba16-403c-b356-973b1bc65956 HTTP/1.1 May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigoxqILdvq9A8X1wyZYZkptjWvjeNnSJbt_m6CzRxtUkVa8jlgFuPE2SUt7SkFJok35g8Vc7FW-yCaNTW8Z1nl2VIvY09ELIxrSPhJq3bUsuf5BEWa3RcckNHi3NB13RYwE7aSCLt87w_1tUpSe2IIPGk6J7bHU7mOpox8osRqxFl3zU May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 94fe0f6c2e964969bd46781356d2539e May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1424263552 May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:40:06.035358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:40:06.036374 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/94fe0f6c2e964969bd46781356d2539e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_94fe0f6c2e964969bd46781356d2539e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/94fe0f6c2e964969bd46781356d2539e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/94fe0f6c2e964969bd46781356d2539e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:40:06.036374 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1424263552 May 16 17:40:06.036374 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 94fe0f6c2e964969bd46781356d2539e May 16 17:40:06.036374 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1424263552 May 16 17:40:06.036374 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-VolumesSnapshotsTestJSON-1424263552-project May 16 17:40:06.036374 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:40:06.036374 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:40:06.036374 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: 2b97874877694c3ea7cbc1af2a848b2a May 16 17:40:06.036374 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1424263552-project May 16 17:40:06.036374 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: May 16 17:40:06.036374 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. May 16 17:40:06.036374 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': '05ae0773-ba16-403c-b356-973b1bc65956'} May 16 17:40:06.036374 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. (HTTP 404) (Request-ID: req-095229df-9da0-41dc-9496-c7a4f341f97e) May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:40:06.037036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 17:40:06.042056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 17:40:06.043868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:40:06.046680 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. May 16 17:40:06.046680 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:40:06.046680 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:40:06.046680 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:40:06.046680 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:40:06.046680 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:40:06.046680 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:40:06.046680 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:40:06.046680 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:40:06.046680 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. May 16 17:40:06.046680 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:40:06.046680 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e6b278e1-1837-4187-862d-5bf228e6021a tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Returning 404 to user: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:40:06.046680 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-e6b278e1-1837-4187-862d-5bf228e6021a tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/05ae0773-ba16-403c-b356-973b1bc65956" status: 404 len: 109 microversion: 2.1 time: 0.076137 May 16 17:40:06.046680 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 25/37] 10.222.0.58 () {58 vars in 1247 bytes} [Mon May 16 17:40:05 2022] DELETE /compute/v2.1/os-volumes/05ae0773-ba16-403c-b356-973b1bc65956 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:40:06.052959 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ee4548fc-117c-463f-8d87-48a5954556ce tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Calling method '.version_select at 0x7f79a567e040>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:06.120931 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-ee4548fc-117c-463f-8d87-48a5954556ce tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] HTTP exception thrown: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ee4548fc-117c-463f-8d87-48a5954556ce tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Request method failure captured: May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: GET /compute/v2.1/os-volumes/05ae0773-ba16-403c-b356-973b1bc65956 HTTP/1.1 May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigoxqILdvq9A8X1wyZYZkptjWvjeNnSJbt_m6CzRxtUkVa8jlgFuPE2SUt7SkFJok35g8Vc7FW-yCaNTW8Z1nl2VIvY09ELIxrSPhJq3bUsuf5BEWa3RcckNHi3NB13RYwE7aSCLt87w_1tUpSe2IIPGk6J7bHU7mOpox8osRqxFl3zU May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 94fe0f6c2e964969bd46781356d2539e May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1424263552 May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:40:06.124198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:40:06.125358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/94fe0f6c2e964969bd46781356d2539e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_94fe0f6c2e964969bd46781356d2539e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/94fe0f6c2e964969bd46781356d2539e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/94fe0f6c2e964969bd46781356d2539e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:40:06.125358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1424263552 May 16 17:40:06.125358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 94fe0f6c2e964969bd46781356d2539e May 16 17:40:06.125358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1424263552 May 16 17:40:06.125358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-VolumesSnapshotsTestJSON-1424263552-project May 16 17:40:06.125358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:40:06.125358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:40:06.125358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 2b97874877694c3ea7cbc1af2a848b2a May 16 17:40:06.125358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1424263552-project May 16 17:40:06.125358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: May 16 17:40:06.125358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. May 16 17:40:06.125358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': '05ae0773-ba16-403c-b356-973b1bc65956'} May 16 17:40:06.125358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. (HTTP 404) (Request-ID: req-44af8a74-9375-4a5d-a6ea-b3d2677ef116) May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:40:06.126925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 17:40:06.128213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 17:40:06.130685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:40:06.133513 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. May 16 17:40:06.133513 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:06.133513 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:40:06.133513 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:06.133513 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:40:06.133513 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:40:06.133513 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:40:06.133513 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:40:06.133513 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:40:06.133513 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. May 16 17:40:06.133513 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:40:06.137724 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ee4548fc-117c-463f-8d87-48a5954556ce tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] Returning 404 to user: Volume 05ae0773-ba16-403c-b356-973b1bc65956 could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:40:06.138839 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ee4548fc-117c-463f-8d87-48a5954556ce tempest-VolumesSnapshotsTestJSON-1424263552 tempest-VolumesSnapshotsTestJSON-1424263552-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/05ae0773-ba16-403c-b356-973b1bc65956" status: 404 len: 109 microversion: 2.1 time: 0.096089 May 16 17:40:06.141209 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 13/38] 10.222.0.58 () {58 vars in 1244 bytes} [Mon May 16 17:40:06 2022] GET /compute/v2.1/os-volumes/05ae0773-ba16-403c-b356-973b1bc65956 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:40:06.630873 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-de4b8030-3f34-4b01-a8f6-457ef8608ecd tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:06.631469 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-de4b8030-3f34-4b01-a8f6-457ef8608ecd tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:06.645062 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-de4b8030-3f34-4b01-a8f6-457ef8608ecd tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:06.664270 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-de4b8030-3f34-4b01-a8f6-457ef8608ecd tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:06.665224 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-de4b8030-3f34-4b01-a8f6-457ef8608ecd tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:06.669233 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-de4b8030-3f34-4b01-a8f6-457ef8608ecd tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:07.236163 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-de4b8030-3f34-4b01-a8f6-457ef8608ecd tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:07.254431 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-de4b8030-3f34-4b01-a8f6-457ef8608ecd tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1313 microversion: 2.1 time: 0.628503 May 16 17:40:07.255011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 26/39] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:06 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1313 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:08.273112 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-11658ddf-b0d7-46f7-a41e-e08892ec586a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:08.274578 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-11658ddf-b0d7-46f7-a41e-e08892ec586a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:08.317028 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-11658ddf-b0d7-46f7-a41e-e08892ec586a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:08.317484 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-11658ddf-b0d7-46f7-a41e-e08892ec586a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:08.318341 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-11658ddf-b0d7-46f7-a41e-e08892ec586a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:08.318772 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-11658ddf-b0d7-46f7-a41e-e08892ec586a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:09.014777 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-11658ddf-b0d7-46f7-a41e-e08892ec586a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:09.039716 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-11658ddf-b0d7-46f7-a41e-e08892ec586a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1313 microversion: 2.1 time: 0.771052 May 16 17:40:09.041478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 14/40] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:08 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1313 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:09.061784 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0aee4104-3227-40a8-91f2-27a04461d15c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-949256594", "imageRef": "782bd628-ef1b-419c-99f5-2c312d1766a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:40:09.298309 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.network.neutron [None req-0aee4104-3227-40a8-91f2-27a04461d15c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] validate_networks() for [('b3aa429a-c40d-42bd-9dfe-fc635bd438c5', None, None, None, None, None)] {{(pid=128815) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:40:09.666587 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f7c82151-6e90-46bc-b1bd-2a9a63b35b1b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Action: 'create', calling method: .version_select at 0x7f79a719d820>, body: {"keypair": {"name": "tempest-keypair-384275017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtN1/yugrvyqpW3/AtXMEYhvpE/z3T8EarKR59oe7IKUMEKSxj9xHngLaLS/HB0JnBJ93eQOc3mKAx+sOnbBhIHgQ5X4yIFF4zTFV4QNlAOEcFyov2To3fCDt+J00fJmQ=="}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:40:09.744517 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-f7c82151-6e90-46bc-b1bd-2a9a63b35b1b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Getting quotas for project 80c60c24806542e889c070d519172e79. Resources: {'key_pairs'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:40:09.766275 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-f7c82151-6e90-46bc-b1bd-2a9a63b35b1b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Getting quotas for user 6838738598ce4d2186e7c0b6547868f6 and project 80c60c24806542e889c070d519172e79. Resources: {'key_pairs'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:40:09.871801 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f7c82151-6e90-46bc-b1bd-2a9a63b35b1b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.764232 May 16 17:40:09.873510 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 15/41] 10.222.0.58 () {60 vars in 1158 bytes} [Mon May 16 17:40:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:40:10.066783 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-fb3efbed-1cc8-45a4-b9ce-d7c787db207d tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:10.069706 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-fb3efbed-1cc8-45a4-b9ce-d7c787db207d tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:10.118909 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fb3efbed-1cc8-45a4-b9ce-d7c787db207d tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:10.136431 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fb3efbed-1cc8-45a4-b9ce-d7c787db207d tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:10.143075 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fb3efbed-1cc8-45a4-b9ce-d7c787db207d tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:10.143615 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fb3efbed-1cc8-45a4-b9ce-d7c787db207d tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:10.817984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-fb3efbed-1cc8-45a4-b9ce-d7c787db207d tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:10.830346 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-fb3efbed-1cc8-45a4-b9ce-d7c787db207d tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1313 microversion: 2.1 time: 0.774113 May 16 17:40:10.833200 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 16/42] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:10 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1313 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:11.669413 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-0aee4104-3227-40a8-91f2-27a04461d15c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Flavor limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:40:11.670618 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-0aee4104-3227-40a8-91f2-27a04461d15c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Image limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:40:11.671558 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-0aee4104-3227-40a8-91f2-27a04461d15c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Flavor pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:40:11.672139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-0aee4104-3227-40a8-91f2-27a04461d15c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Image pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:40:11.672716 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-0aee4104-3227-40a8-91f2-27a04461d15c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:40:11.723290 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0aee4104-3227-40a8-91f2-27a04461d15c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:11.724946 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0aee4104-3227-40a8-91f2-27a04461d15c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:11.731885 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0aee4104-3227-40a8-91f2-27a04461d15c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:11.733915 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0aee4104-3227-40a8-91f2-27a04461d15c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:11.766144 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-cec1e126-891b-4916-845d-a25bb4beed5c req-04d78993-91a9-48ad-a666-314003f29819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a28e9f51-66b9-4218-a81f-08a168cbeb32", "tag": "4df5132e-30e3-4c40-bd03-2d1fd0a87011"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:40:11.808024 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-cec1e126-891b-4916-845d-a25bb4beed5c req-04d78993-91a9-48ad-a666-314003f29819 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:11.808486 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-cec1e126-891b-4916-845d-a25bb4beed5c req-04d78993-91a9-48ad-a666-314003f29819 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:11.851289 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-0aee4104-3227-40a8-91f2-27a04461d15c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Getting quotas for project 1eddf9ae85b940b8bd556f4cf66c0b79. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:40:11.875958 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-0aee4104-3227-40a8-91f2-27a04461d15c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Getting quotas for user c482d82afb734e10a5a11070fcb5f736 and project 1eddf9ae85b940b8bd556f4cf66c0b79. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:40:11.912395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-cec1e126-891b-4916-845d-a25bb4beed5c req-04d78993-91a9-48ad-a666-314003f29819 service nova] Creating event network-changed:4df5132e-30e3-4c40-bd03-2d1fd0a87011 for instance a28e9f51-66b9-4218-a81f-08a168cbeb32 on hv-cinder-83769 May 16 17:40:11.919865 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-cec1e126-891b-4916-845d-a25bb4beed5c req-04d78993-91a9-48ad-a666-314003f29819 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128816) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 16 17:40:11.923122 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-36552e07-6921-467d-8bd5-9621fe1167a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:11.925084 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-36552e07-6921-467d-8bd5-9621fe1167a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:11.925328 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-0aee4104-3227-40a8-91f2-27a04461d15c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Going to run 1 instances... {{(pid=128815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:40:11.927777 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-36552e07-6921-467d-8bd5-9621fe1167a6 None None] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:11.941981 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-36552e07-6921-467d-8bd5-9621fe1167a6 None None] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:11.948276 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-0aee4104-3227-40a8-91f2-27a04461d15c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='782bd628-ef1b-419c-99f5-2c312d1766a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:40:11.986592 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.compute.rpcapi [None req-36552e07-6921-467d-8bd5-9621fe1167a6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 16 17:40:11.987565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-36552e07-6921-467d-8bd5-9621fe1167a6 None None] Releasing lock "compute-rpcapi-router" {{(pid=128816) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 16 17:40:12.015843 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-36552e07-6921-467d-8bd5-9621fe1167a6 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.369075 May 16 17:40:12.017023 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 17/43] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:12.028991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-01c40670-94b9-40d9-81e9-a1ab9f1a13cc tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:12.030158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-01c40670-94b9-40d9-81e9-a1ab9f1a13cc tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:12.037971 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-01c40670-94b9-40d9-81e9-a1ab9f1a13cc tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:12.038677 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-01c40670-94b9-40d9-81e9-a1ab9f1a13cc tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:12.039758 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-01c40670-94b9-40d9-81e9-a1ab9f1a13cc tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:12.040491 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-01c40670-94b9-40d9-81e9-a1ab9f1a13cc tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:12.220313 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-0aee4104-3227-40a8-91f2-27a04461d15c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.840553 May 16 17:40:12.227073 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 27/44] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:40:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 3848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:40:12.234119 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-a47aad93-3aff-4c59-95f0-f5b3e1612ef8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:12.235043 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a47aad93-3aff-4c59-95f0-f5b3e1612ef8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:12.511894 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-a47aad93-3aff-4c59-95f0-f5b3e1612ef8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:12.551404 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-a47aad93-3aff-4c59-95f0-f5b3e1612ef8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1221 microversion: 2.1 time: 0.322148 May 16 17:40:12.557402 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-01c40670-94b9-40d9-81e9-a1ab9f1a13cc tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:12.561714 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 28/45] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:12 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1221 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:12.569001 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-01c40670-94b9-40d9-81e9-a1ab9f1a13cc tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1313 microversion: 2.1 time: 0.547812 May 16 17:40:12.582008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 18/46] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:12 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1313 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:12.707208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-a8487068-5df1-447b-9ef9-849e1a6207d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-875611334", "imageRef": "782bd628-ef1b-419c-99f5-2c312d1766a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:40:12.903749 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.network.neutron [None req-a8487068-5df1-447b-9ef9-849e1a6207d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] validate_networks() for [('b3aa429a-c40d-42bd-9dfe-fc635bd438c5', None, None, None, None, None)] {{(pid=128815) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:40:13.598807 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b1e7cb41-f32f-4173-8fba-53f0065c3142 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:13.599434 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b1e7cb41-f32f-4173-8fba-53f0065c3142 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:13.612987 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b1e7cb41-f32f-4173-8fba-53f0065c3142 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:13.613528 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b1e7cb41-f32f-4173-8fba-53f0065c3142 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:13.624725 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b1e7cb41-f32f-4173-8fba-53f0065c3142 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:13.625309 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b1e7cb41-f32f-4173-8fba-53f0065c3142 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:14.593071 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-b1e7cb41-f32f-4173-8fba-53f0065c3142 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:14.601030 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b1e7cb41-f32f-4173-8fba-53f0065c3142 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1313 microversion: 2.1 time: 1.017623 May 16 17:40:14.606599 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 19/47] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:13 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1313 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:14.711260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-a8487068-5df1-447b-9ef9-849e1a6207d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Flavor limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:40:14.711761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-a8487068-5df1-447b-9ef9-849e1a6207d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Image limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:40:14.712142 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-a8487068-5df1-447b-9ef9-849e1a6207d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Flavor pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:40:14.712554 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-a8487068-5df1-447b-9ef9-849e1a6207d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Image pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:40:14.712971 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-a8487068-5df1-447b-9ef9-849e1a6207d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:40:14.736904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a8487068-5df1-447b-9ef9-849e1a6207d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:14.739226 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a8487068-5df1-447b-9ef9-849e1a6207d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:14.740378 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a8487068-5df1-447b-9ef9-849e1a6207d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:14.742948 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a8487068-5df1-447b-9ef9-849e1a6207d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:14.817986 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-a8487068-5df1-447b-9ef9-849e1a6207d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Getting quotas for project 1eddf9ae85b940b8bd556f4cf66c0b79. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:40:14.827201 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-a8487068-5df1-447b-9ef9-849e1a6207d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Getting quotas for user c482d82afb734e10a5a11070fcb5f736 and project 1eddf9ae85b940b8bd556f4cf66c0b79. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:40:14.842925 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a8487068-5df1-447b-9ef9-849e1a6207d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Going to run 1 instances... {{(pid=128815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:40:14.846168 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a8487068-5df1-447b-9ef9-849e1a6207d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='782bd628-ef1b-419c-99f5-2c312d1766a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:40:14.986392 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-a8487068-5df1-447b-9ef9-849e1a6207d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.282130 May 16 17:40:15.000389 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d2b42f3c-9942-44f8-b4ed-f83dd8fc1e07 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:15.001425 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d2b42f3c-9942-44f8-b4ed-f83dd8fc1e07 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:15.006475 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 29/48] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:40:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 2305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:40:15.222112 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d2b42f3c-9942-44f8-b4ed-f83dd8fc1e07 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:15.279235 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d2b42f3c-9942-44f8-b4ed-f83dd8fc1e07 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1221 microversion: 2.1 time: 0.281092 May 16 17:40:15.293720 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 20/49] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:14 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1221 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:15.628638 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-02ad6abf-1af3-4c28-8d54-4133d3067e97 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:15.631592 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-02ad6abf-1af3-4c28-8d54-4133d3067e97 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:15.707064 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-02ad6abf-1af3-4c28-8d54-4133d3067e97 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:15.707595 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-02ad6abf-1af3-4c28-8d54-4133d3067e97 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:15.719083 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-02ad6abf-1af3-4c28-8d54-4133d3067e97 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:15.731229 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-02ad6abf-1af3-4c28-8d54-4133d3067e97 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:16.297835 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-67d1102a-0ef1-4828-a688-525a96ab3a83 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:16.298452 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-67d1102a-0ef1-4828-a688-525a96ab3a83 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:16.312218 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-67d1102a-0ef1-4828-a688-525a96ab3a83 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:16.312674 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-67d1102a-0ef1-4828-a688-525a96ab3a83 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:16.313572 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-67d1102a-0ef1-4828-a688-525a96ab3a83 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:16.314042 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-67d1102a-0ef1-4828-a688-525a96ab3a83 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:16.692488 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-02ad6abf-1af3-4c28-8d54-4133d3067e97 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:16.717924 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-67d1102a-0ef1-4828-a688-525a96ab3a83 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:16.728978 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-02ad6abf-1af3-4c28-8d54-4133d3067e97 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1313 microversion: 2.1 time: 1.082023 May 16 17:40:16.730993 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 30/50] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:15 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1313 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:16.732567 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-67d1102a-0ef1-4828-a688-525a96ab3a83 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1225 microversion: 2.1 time: 0.439191 May 16 17:40:16.737836 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 21/51] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:16 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1225 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:16.886971 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-a2cc2f3a-abdf-454e-bacc-8305cc25ae93 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-323240218", "imageRef": "782bd628-ef1b-419c-99f5-2c312d1766a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28ed5c22-d613-46a9-98e4-5aa888da0e5a"}], "security_groups": [{"name": "tempest-securitygroup--132635032"}], "key_name": "tempest-keypair-384275017", "user_data": "}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:40:17.354657 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b4a0a0cd-318f-443c-934a-d19d244e3250 tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] Calling method '.version_select at 0x7f79a5545b80>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:17.584066 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b4a0a0cd-318f-443c-934a-d19d244e3250 tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2011ea28-ef42-4e2c-bdae-0d6355352c03" status: 200 len: 350 microversion: 2.1 time: 0.233190 May 16 17:40:17.584949 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 22/52] 10.222.0.58 () {58 vars in 1244 bytes} [Mon May 16 17:40:17 2022] GET /compute/v2.1/os-volumes/2011ea28-ef42-4e2c-bdae-0d6355352c03 => generated 350 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:17.701782 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.network.neutron [None req-a2cc2f3a-abdf-454e-bacc-8305cc25ae93 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] validate_networks() for [('28ed5c22-d613-46a9-98e4-5aa888da0e5a', None, None, None, None, None)] {{(pid=128815) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:40:17.747624 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-36989f7a-175b-45c6-b36b-bca1f6e50fa0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:17.748402 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-36989f7a-175b-45c6-b36b-bca1f6e50fa0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:17.754803 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-36989f7a-175b-45c6-b36b-bca1f6e50fa0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:17.755527 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-36989f7a-175b-45c6-b36b-bca1f6e50fa0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:17.756304 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-36989f7a-175b-45c6-b36b-bca1f6e50fa0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:17.756883 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-36989f7a-175b-45c6-b36b-bca1f6e50fa0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:18.092366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-36989f7a-175b-45c6-b36b-bca1f6e50fa0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:18.099972 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-36989f7a-175b-45c6-b36b-bca1f6e50fa0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1313 microversion: 2.1 time: 0.356536 May 16 17:40:18.100556 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 23/53] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:17 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:18.113840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c62d0401-f802-41d3-8daa-21131ff86060 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:18.114518 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-c62d0401-f802-41d3-8daa-21131ff86060 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:18.120510 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c62d0401-f802-41d3-8daa-21131ff86060 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:18.121190 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c62d0401-f802-41d3-8daa-21131ff86060 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:18.121976 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c62d0401-f802-41d3-8daa-21131ff86060 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:18.122435 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c62d0401-f802-41d3-8daa-21131ff86060 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:18.266889 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-c62d0401-f802-41d3-8daa-21131ff86060 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:18.274778 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-c62d0401-f802-41d3-8daa-21131ff86060 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1217 microversion: 2.1 time: 0.164564 May 16 17:40:18.275355 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 24/54] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:18 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1217 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:18.448204 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-a2cc2f3a-abdf-454e-bacc-8305cc25ae93 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Flavor limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:40:18.448749 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-a2cc2f3a-abdf-454e-bacc-8305cc25ae93 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Image limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:40:18.449310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-a2cc2f3a-abdf-454e-bacc-8305cc25ae93 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Flavor pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:40:18.449789 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-a2cc2f3a-abdf-454e-bacc-8305cc25ae93 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Image pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:40:18.450203 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-a2cc2f3a-abdf-454e-bacc-8305cc25ae93 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:40:18.459070 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a2cc2f3a-abdf-454e-bacc-8305cc25ae93 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:18.459525 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a2cc2f3a-abdf-454e-bacc-8305cc25ae93 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:18.460318 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a2cc2f3a-abdf-454e-bacc-8305cc25ae93 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:18.460750 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a2cc2f3a-abdf-454e-bacc-8305cc25ae93 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:18.476713 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-a2cc2f3a-abdf-454e-bacc-8305cc25ae93 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Getting quotas for project 80c60c24806542e889c070d519172e79. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:40:18.480403 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-a2cc2f3a-abdf-454e-bacc-8305cc25ae93 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Getting quotas for user 6838738598ce4d2186e7c0b6547868f6 and project 80c60c24806542e889c070d519172e79. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:40:18.491663 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a2cc2f3a-abdf-454e-bacc-8305cc25ae93 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Going to run 1 instances... {{(pid=128815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:40:18.493911 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a2cc2f3a-abdf-454e-bacc-8305cc25ae93 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='782bd628-ef1b-419c-99f5-2c312d1766a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:40:18.542749 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-a2cc2f3a-abdf-454e-bacc-8305cc25ae93 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.661002 May 16 17:40:18.543399 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 31/55] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:40:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:40:18.554880 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9b8f36a6-6e39-4e4a-bfd6-b337636b38c7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:18.558652 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-9b8f36a6-6e39-4e4a-bfd6-b337636b38c7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:18.612401 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9b8f36a6-6e39-4e4a-bfd6-b337636b38c7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:18.619102 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-9b8f36a6-6e39-4e4a-bfd6-b337636b38c7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1240 microversion: 2.1 time: 0.068854 May 16 17:40:18.619679 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 25/56] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:18 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:19.116788 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-9dcfffa2-6869-468a-b7ce-a4d20cccaa87 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:19.117415 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-9dcfffa2-6869-468a-b7ce-a4d20cccaa87 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:19.123814 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9dcfffa2-6869-468a-b7ce-a4d20cccaa87 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:19.124211 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9dcfffa2-6869-468a-b7ce-a4d20cccaa87 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:19.124986 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9dcfffa2-6869-468a-b7ce-a4d20cccaa87 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:19.125447 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9dcfffa2-6869-468a-b7ce-a4d20cccaa87 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:19.266008 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-9dcfffa2-6869-468a-b7ce-a4d20cccaa87 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:19.273509 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-9dcfffa2-6869-468a-b7ce-a4d20cccaa87 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1313 microversion: 2.1 time: 0.160980 May 16 17:40:19.274301 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 32/57] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:19 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:19.291732 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b375d173-d756-4846-9a29-fdf27d104749 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:19.292341 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b375d173-d756-4846-9a29-fdf27d104749 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:19.298866 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b375d173-d756-4846-9a29-fdf27d104749 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:19.299359 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b375d173-d756-4846-9a29-fdf27d104749 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:19.300110 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b375d173-d756-4846-9a29-fdf27d104749 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:19.300549 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b375d173-d756-4846-9a29-fdf27d104749 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:19.362393 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-b375d173-d756-4846-9a29-fdf27d104749 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:19.373693 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b375d173-d756-4846-9a29-fdf27d104749 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1217 microversion: 2.1 time: 0.085775 May 16 17:40:19.374539 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 26/58] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:19 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:19.637013 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ba58b613-6409-4818-9850-9e86a51cabb6 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:19.637760 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ba58b613-6409-4818-9850-9e86a51cabb6 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:19.644152 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ba58b613-6409-4818-9850-9e86a51cabb6 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:19.644693 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ba58b613-6409-4818-9850-9e86a51cabb6 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:19.645669 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ba58b613-6409-4818-9850-9e86a51cabb6 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:19.658020 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ba58b613-6409-4818-9850-9e86a51cabb6 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:19.730337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ba58b613-6409-4818-9850-9e86a51cabb6 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:19.737979 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ba58b613-6409-4818-9850-9e86a51cabb6 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1244 microversion: 2.1 time: 0.105167 May 16 17:40:19.738567 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 33/59] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:19 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1244 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:20.292520 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-3d9455dd-d7af-4b67-aa0c-77f35fa84fe7 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:20.294054 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-3d9455dd-d7af-4b67-aa0c-77f35fa84fe7 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:20.301201 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3d9455dd-d7af-4b67-aa0c-77f35fa84fe7 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:20.302137 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3d9455dd-d7af-4b67-aa0c-77f35fa84fe7 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:20.303143 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3d9455dd-d7af-4b67-aa0c-77f35fa84fe7 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:20.303973 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3d9455dd-d7af-4b67-aa0c-77f35fa84fe7 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:20.391992 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e6553a1e-a045-44bf-afe6-32bcc47914c3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:20.392919 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-e6553a1e-a045-44bf-afe6-32bcc47914c3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:20.404465 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e6553a1e-a045-44bf-afe6-32bcc47914c3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:20.404778 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e6553a1e-a045-44bf-afe6-32bcc47914c3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:20.405832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e6553a1e-a045-44bf-afe6-32bcc47914c3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:20.406512 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e6553a1e-a045-44bf-afe6-32bcc47914c3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:20.494664 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-e6553a1e-a045-44bf-afe6-32bcc47914c3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:20.504700 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-e6553a1e-a045-44bf-afe6-32bcc47914c3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1217 microversion: 2.1 time: 0.116910 May 16 17:40:20.509664 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-3d9455dd-d7af-4b67-aa0c-77f35fa84fe7 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:20.513654 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 34/60] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:20 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:20.518156 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-3d9455dd-d7af-4b67-aa0c-77f35fa84fe7 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1313 microversion: 2.1 time: 0.230482 May 16 17:40:20.528678 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 27/61] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:20 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:20.755190 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-57c9a4ed-503c-4c26-ba62-6c1eafb98e94 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:20.755980 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-57c9a4ed-503c-4c26-ba62-6c1eafb98e94 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:20.765977 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-57c9a4ed-503c-4c26-ba62-6c1eafb98e94 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:20.766199 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-57c9a4ed-503c-4c26-ba62-6c1eafb98e94 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:20.766848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-57c9a4ed-503c-4c26-ba62-6c1eafb98e94 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:20.767293 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-57c9a4ed-503c-4c26-ba62-6c1eafb98e94 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:20.832834 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-57c9a4ed-503c-4c26-ba62-6c1eafb98e94 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:20.841297 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-57c9a4ed-503c-4c26-ba62-6c1eafb98e94 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1244 microversion: 2.1 time: 0.090018 May 16 17:40:20.841902 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 35/62] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:20 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:21.204122 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d8641408-708a-46b0-9b4a-459da3cc1847 tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] Calling method '.version_select at 0x7f79a4cdc5e0>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:21.317078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d8641408-708a-46b0-9b4a-459da3cc1847 tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c4cc2ccf-40ec-4c11-8937-4cc6f99dfffa" status: 200 len: 350 microversion: 2.1 time: 0.116440 May 16 17:40:21.317775 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 28/63] 10.222.0.58 () {58 vars in 1244 bytes} [Mon May 16 17:40:21 2022] GET /compute/v2.1/os-volumes/c4cc2ccf-40ec-4c11-8937-4cc6f99dfffa => generated 350 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:21.530424 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-eaf46f68-f8c5-408b-b048-64b7d49938dd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:21.531545 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-eaf46f68-f8c5-408b-b048-64b7d49938dd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:21.537575 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-bd9255e1-0898-478e-9c8a-657051acd3e0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:21.538378 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-bd9255e1-0898-478e-9c8a-657051acd3e0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:21.542397 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-eaf46f68-f8c5-408b-b048-64b7d49938dd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:21.545480 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-eaf46f68-f8c5-408b-b048-64b7d49938dd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:21.548585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-eaf46f68-f8c5-408b-b048-64b7d49938dd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:21.549060 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-eaf46f68-f8c5-408b-b048-64b7d49938dd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:21.549806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bd9255e1-0898-478e-9c8a-657051acd3e0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:21.551536 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bd9255e1-0898-478e-9c8a-657051acd3e0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:21.552885 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bd9255e1-0898-478e-9c8a-657051acd3e0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:21.553451 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bd9255e1-0898-478e-9c8a-657051acd3e0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:21.764865 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-eaf46f68-f8c5-408b-b048-64b7d49938dd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:21.773294 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-eaf46f68-f8c5-408b-b048-64b7d49938dd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1273 microversion: 2.1 time: 0.246801 May 16 17:40:21.774279 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 36/64] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:21 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:21.859909 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-dc4a71e4-a504-4fb6-bf5e-65ec135c5103 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:21.860654 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-dc4a71e4-a504-4fb6-bf5e-65ec135c5103 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:21.867714 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dc4a71e4-a504-4fb6-bf5e-65ec135c5103 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:21.868449 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dc4a71e4-a504-4fb6-bf5e-65ec135c5103 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:21.869694 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dc4a71e4-a504-4fb6-bf5e-65ec135c5103 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:21.870339 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dc4a71e4-a504-4fb6-bf5e-65ec135c5103 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:21.906758 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-bd9255e1-0898-478e-9c8a-657051acd3e0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:21.914756 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-bd9255e1-0898-478e-9c8a-657051acd3e0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1313 microversion: 2.1 time: 0.382328 May 16 17:40:21.915617 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 29/65] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:21 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:21.943721 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-dc4a71e4-a504-4fb6-bf5e-65ec135c5103 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:21.952791 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-dc4a71e4-a504-4fb6-bf5e-65ec135c5103 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1236 microversion: 2.1 time: 0.096964 May 16 17:40:21.953639 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 37/66] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:21 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1236 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:40:22.798544 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-916f9a50-be89-4624-a626-80be58579517 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:22.799824 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-916f9a50-be89-4624-a626-80be58579517 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:22.815366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-916f9a50-be89-4624-a626-80be58579517 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:22.819437 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-916f9a50-be89-4624-a626-80be58579517 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:22.820689 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-916f9a50-be89-4624-a626-80be58579517 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:22.822416 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-916f9a50-be89-4624-a626-80be58579517 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:22.984051 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-916f9a50-be89-4624-a626-80be58579517 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:22.999551 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-916f9a50-be89-4624-a626-80be58579517 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1273 microversion: 2.1 time: 0.212967 May 16 17:40:23.009425 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 30/67] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:22 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:23.014872 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e9c365f8-bc55-439d-ba15-0c0feaeca30c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:23.015396 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e9c365f8-bc55-439d-ba15-0c0feaeca30c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:23.022163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e9c365f8-bc55-439d-ba15-0c0feaeca30c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:23.022793 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e9c365f8-bc55-439d-ba15-0c0feaeca30c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:23.023710 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e9c365f8-bc55-439d-ba15-0c0feaeca30c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:23.024323 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e9c365f8-bc55-439d-ba15-0c0feaeca30c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:23.123927 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-6542cbbf-60c8-4596-bb31-3757d286c0ac req-04254c47-6ea6-4d1e-bf15-ba92b89ca976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b033cd6f-aebe-48ae-aefd-f505e6f16bbc", "tag": "d9c5c334-51e8-4667-bc89-5b3cf71031cf"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:40:23.140029 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-6542cbbf-60c8-4596-bb31-3757d286c0ac req-04254c47-6ea6-4d1e-bf15-ba92b89ca976 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:23.140898 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-6542cbbf-60c8-4596-bb31-3757d286c0ac req-04254c47-6ea6-4d1e-bf15-ba92b89ca976 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:23.180986 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-6542cbbf-60c8-4596-bb31-3757d286c0ac req-04254c47-6ea6-4d1e-bf15-ba92b89ca976 service nova] Creating event network-changed:d9c5c334-51e8-4667-bc89-5b3cf71031cf for instance b033cd6f-aebe-48ae-aefd-f505e6f16bbc on hv-cinder-83769 May 16 17:40:23.183649 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-6542cbbf-60c8-4596-bb31-3757d286c0ac req-04254c47-6ea6-4d1e-bf15-ba92b89ca976 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128815) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 16 17:40:23.186646 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f7850375-e15c-46dc-a53e-bdd9c21e3bea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:23.188285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f7850375-e15c-46dc-a53e-bdd9c21e3bea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:23.191246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f7850375-e15c-46dc-a53e-bdd9c21e3bea None None] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:23.191909 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f7850375-e15c-46dc-a53e-bdd9c21e3bea None None] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:23.209885 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.compute.rpcapi [None req-f7850375-e15c-46dc-a53e-bdd9c21e3bea None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 16 17:40:23.211154 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f7850375-e15c-46dc-a53e-bdd9c21e3bea None None] Releasing lock "compute-rpcapi-router" {{(pid=128815) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 16 17:40:23.252936 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f7850375-e15c-46dc-a53e-bdd9c21e3bea None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.372460 May 16 17:40:23.254273 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 38/68] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:23.263405 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-51815588-2503-41b7-9f61-7011b8f77861 tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] Calling method '.version_select at 0x7f79a5504d30>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:23.361757 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-51815588-2503-41b7-9f61-7011b8f77861 tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/b876eaf0-6460-462c-b8af-1928df1bddeb" status: 200 len: 350 microversion: 2.1 time: 0.105343 May 16 17:40:23.362553 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 39/69] 10.222.0.58 () {58 vars in 1244 bytes} [Mon May 16 17:40:23 2022] GET /compute/v2.1/os-volumes/b876eaf0-6460-462c-b8af-1928df1bddeb => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:23.370571 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-19ade423-ff12-4e2d-b119-308f9705beee tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:23.372298 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-19ade423-ff12-4e2d-b119-308f9705beee tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:23.389573 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-19ade423-ff12-4e2d-b119-308f9705beee tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:23.398203 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-19ade423-ff12-4e2d-b119-308f9705beee tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:23.399060 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-19ade423-ff12-4e2d-b119-308f9705beee tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:23.399504 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-19ade423-ff12-4e2d-b119-308f9705beee tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:23.573317 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-19ade423-ff12-4e2d-b119-308f9705beee tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:23.575352 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e9c365f8-bc55-439d-ba15-0c0feaeca30c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:23.588407 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e9c365f8-bc55-439d-ba15-0c0feaeca30c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1313 microversion: 2.1 time: 0.577761 May 16 17:40:23.589074 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 31/70] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:23 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1313 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:23.589355 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-19ade423-ff12-4e2d-b119-308f9705beee tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1300 microversion: 2.1 time: 0.225119 May 16 17:40:23.590910 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 40/71] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:23 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1300 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:23.594029 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-412a85bf-744b-46f6-a70b-99eb1b1b11a2 tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] Calling method '.version_select at 0x7f79a4cdcee0>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:23.679211 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-412a85bf-744b-46f6-a70b-99eb1b1b11a2 tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.088756 May 16 17:40:23.687350 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 32/72] 10.222.0.58 () {58 vars in 1133 bytes} [Mon May 16 17:40:23 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:23.692635 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-bc012c66-fc16-4964-b182-5d6d3bf3d49b tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] Calling method '.version_select at 0x7f79a5504820>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:23.779332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-bc012c66-fc16-4964-b182-5d6d3bf3d49b tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.090850 May 16 17:40:23.780096 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 41/73] 10.222.0.58 () {58 vars in 1148 bytes} [Mon May 16 17:40:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:40:23.794584 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-cc09c935-cfc0-4189-9d9c-42c050dfab1c tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] Calling method '.version_select at 0x7f79a4cc1af0>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:23.926569 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-cc09c935-cfc0-4189-9d9c-42c050dfab1c tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.136766 May 16 17:40:23.927186 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 33/74] 10.222.0.58 () {58 vars in 1133 bytes} [Mon May 16 17:40:23 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:23.938667 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-9a116776-14a7-4d7f-9df5-1ad2473a8cab tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] Calling method '.version_select at 0x7f79a5d77ca0>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:24.016765 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-76d990df-0c70-4a71-8647-34792d53d993 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:24.017406 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-76d990df-0c70-4a71-8647-34792d53d993 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:24.034404 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-76d990df-0c70-4a71-8647-34792d53d993 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:24.034671 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-76d990df-0c70-4a71-8647-34792d53d993 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:24.039110 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-9a116776-14a7-4d7f-9df5-1ad2473a8cab tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.104473 May 16 17:40:24.039995 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 42/75] 10.222.0.58 () {58 vars in 1166 bytes} [Mon May 16 17:40:23 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:24.053927 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-31142e46-f57b-43e0-a73d-dfc77abe09cd tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] Calling method '.version_select at 0x7f79a5d519d0>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:24.057941 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-76d990df-0c70-4a71-8647-34792d53d993 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:24.062565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-76d990df-0c70-4a71-8647-34792d53d993 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:24.189582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-76d990df-0c70-4a71-8647-34792d53d993 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:24.213164 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-76d990df-0c70-4a71-8647-34792d53d993 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1279 microversion: 2.1 time: 0.200539 May 16 17:40:24.214284 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 34/76] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:24 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1279 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:24.320944 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-31142e46-f57b-43e0-a73d-dfc77abe09cd tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.273108 May 16 17:40:24.321542 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 43/77] 10.222.0.58 () {58 vars in 1169 bytes} [Mon May 16 17:40:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:40:24.333645 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e189c569-8755-459b-ad59-ea0f299f135d tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] Calling method '.version_select at 0x7f79a4cc19d0>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:24.605846 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-90fb5bb2-11b0-4f82-bbb1-0372f11b7f1f tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:24.606577 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-90fb5bb2-11b0-4f82-bbb1-0372f11b7f1f tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:24.625030 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-90fb5bb2-11b0-4f82-bbb1-0372f11b7f1f tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:24.625494 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-90fb5bb2-11b0-4f82-bbb1-0372f11b7f1f tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:24.626368 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-90fb5bb2-11b0-4f82-bbb1-0372f11b7f1f tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:24.630765 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-90fb5bb2-11b0-4f82-bbb1-0372f11b7f1f tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:24.699827 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e189c569-8755-459b-ad59-ea0f299f135d tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.370152 May 16 17:40:24.700418 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 35/78] 10.222.0.58 () {58 vars in 1154 bytes} [Mon May 16 17:40:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:24.706796 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-687c86d1-170b-451a-89cc-cf6531de08f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:24.706796 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-687c86d1-170b-451a-89cc-cf6531de08f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:24.722097 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-687c86d1-170b-451a-89cc-cf6531de08f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:24.722547 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-687c86d1-170b-451a-89cc-cf6531de08f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:24.723334 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-687c86d1-170b-451a-89cc-cf6531de08f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:24.723838 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-687c86d1-170b-451a-89cc-cf6531de08f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:25.062949 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-687c86d1-170b-451a-89cc-cf6531de08f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:25.091572 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-687c86d1-170b-451a-89cc-cf6531de08f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1298 microversion: 2.1 time: 0.389992 May 16 17:40:25.118862 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 36/79] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:24 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1298 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:25.123936 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-66ffabd5-8a6e-42b0-adfc-3458972739e5 tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] Calling method '.version_select at 0x7f79a4cc1af0>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:25.304630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-90fb5bb2-11b0-4f82-bbb1-0372f11b7f1f tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:25.315165 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-90fb5bb2-11b0-4f82-bbb1-0372f11b7f1f tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1313 microversion: 2.1 time: 0.714050 May 16 17:40:25.332278 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 44/80] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:24 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1313 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:25.354763 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-2638428f-bb0d-4e7d-a951-06469f398dbb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:25.355925 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-2638428f-bb0d-4e7d-a951-06469f398dbb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:25.375497 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2638428f-bb0d-4e7d-a951-06469f398dbb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:25.381303 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2638428f-bb0d-4e7d-a951-06469f398dbb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:25.385537 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2638428f-bb0d-4e7d-a951-06469f398dbb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:25.387896 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2638428f-bb0d-4e7d-a951-06469f398dbb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:25.471304 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-66ffabd5-8a6e-42b0-adfc-3458972739e5 tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.351168 May 16 17:40:25.472225 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 37/81] 10.222.0.58 () {58 vars in 1187 bytes} [Mon May 16 17:40:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:25.484714 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ec6091d3-6e61-41ca-900e-910e1eef8371 tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] Calling method '.version_select at 0x7f79a567e940>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:25.587115 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ec6091d3-6e61-41ca-900e-910e1eef8371 tempest-VolumesTestJSON-468232283 tempest-VolumesTestJSON-468232283-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.106766 May 16 17:40:25.587920 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 38/82] 10.222.0.58 () {58 vars in 1154 bytes} [Mon May 16 17:40:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:25.965749 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-2638428f-bb0d-4e7d-a951-06469f398dbb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:25.977527 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-2638428f-bb0d-4e7d-a951-06469f398dbb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1321 microversion: 2.1 time: 0.639277 May 16 17:40:25.980302 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 45/83] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:25 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1321 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:26.111427 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-2def2401-dd6d-4d61-ba61-8fcc2c9b0600 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:26.112692 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-2def2401-dd6d-4d61-ba61-8fcc2c9b0600 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:26.130592 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2def2401-dd6d-4d61-ba61-8fcc2c9b0600 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:26.134394 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2def2401-dd6d-4d61-ba61-8fcc2c9b0600 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:26.135987 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2def2401-dd6d-4d61-ba61-8fcc2c9b0600 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:26.141081 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2def2401-dd6d-4d61-ba61-8fcc2c9b0600 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:26.338163 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-45170599-4e99-47db-bbd3-d241465ecc1b tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:26.339356 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-45170599-4e99-47db-bbd3-d241465ecc1b tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:26.367042 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-45170599-4e99-47db-bbd3-d241465ecc1b tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:26.368489 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-45170599-4e99-47db-bbd3-d241465ecc1b tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:26.371057 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-45170599-4e99-47db-bbd3-d241465ecc1b tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:26.384390 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-45170599-4e99-47db-bbd3-d241465ecc1b tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:27.105257 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-2def2401-dd6d-4d61-ba61-8fcc2c9b0600 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:27.113765 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-2def2401-dd6d-4d61-ba61-8fcc2c9b0600 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1365 microversion: 2.1 time: 1.009205 May 16 17:40:27.120893 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 39/84] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:26 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1365 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:27.146857 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-45170599-4e99-47db-bbd3-d241465ecc1b tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:27.151571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-a0be70c1-0b9d-488e-87a2-aa254ac5d3fd req-e7589eff-ff19-4147-a7a0-3e69ab3d8198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8ac2f4d-715e-4f43-b3fd-1766c17850b9", "tag": "90aff3c1-0c10-404b-852f-cb00af0b6710"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:40:27.158185 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-45170599-4e99-47db-bbd3-d241465ecc1b tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1313 microversion: 2.1 time: 0.825506 May 16 17:40:27.161854 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 46/85] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:26 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1313 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:40:27.175417 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-a0be70c1-0b9d-488e-87a2-aa254ac5d3fd req-e7589eff-ff19-4147-a7a0-3e69ab3d8198 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:27.176815 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-a0be70c1-0b9d-488e-87a2-aa254ac5d3fd req-e7589eff-ff19-4147-a7a0-3e69ab3d8198 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:27.229328 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-a0be70c1-0b9d-488e-87a2-aa254ac5d3fd req-e7589eff-ff19-4147-a7a0-3e69ab3d8198 service nova] Creating event network-changed:90aff3c1-0c10-404b-852f-cb00af0b6710 for instance d8ac2f4d-715e-4f43-b3fd-1766c17850b9 on hv-cinder-83769 May 16 17:40:27.241739 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-a0be70c1-0b9d-488e-87a2-aa254ac5d3fd req-e7589eff-ff19-4147-a7a0-3e69ab3d8198 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104370 May 16 17:40:27.247285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 40/86] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:27.268401 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-2350649c-7583-4899-ac79-76ab47b1734b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:27.269001 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-2350649c-7583-4899-ac79-76ab47b1734b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:27.288333 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2350649c-7583-4899-ac79-76ab47b1734b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:27.288797 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2350649c-7583-4899-ac79-76ab47b1734b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:27.291149 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2350649c-7583-4899-ac79-76ab47b1734b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:27.292683 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2350649c-7583-4899-ac79-76ab47b1734b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:27.466573 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-98396880-bbad-4b9a-acbc-101e9d54397d req-680d57e2-a82b-40c7-aae8-bf5a3daa9060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28e9f51-66b9-4218-a81f-08a168cbeb32", "name": "network-vif-plugged", "status": "completed", "tag": "4df5132e-30e3-4c40-bd03-2d1fd0a87011"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:40:27.489630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-98396880-bbad-4b9a-acbc-101e9d54397d req-680d57e2-a82b-40c7-aae8-bf5a3daa9060 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:27.490235 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-98396880-bbad-4b9a-acbc-101e9d54397d req-680d57e2-a82b-40c7-aae8-bf5a3daa9060 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:27.515760 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-98396880-bbad-4b9a-acbc-101e9d54397d req-680d57e2-a82b-40c7-aae8-bf5a3daa9060 service nova] Creating event network-vif-plugged:4df5132e-30e3-4c40-bd03-2d1fd0a87011 for instance a28e9f51-66b9-4218-a81f-08a168cbeb32 on hv-cinder-83769 May 16 17:40:27.527612 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-98396880-bbad-4b9a-acbc-101e9d54397d req-680d57e2-a82b-40c7-aae8-bf5a3daa9060 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.364156 May 16 17:40:27.531298 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 47/87] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:27.622403 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-2350649c-7583-4899-ac79-76ab47b1734b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:27.634323 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-2350649c-7583-4899-ac79-76ab47b1734b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1321 microversion: 2.1 time: 0.385743 May 16 17:40:27.635174 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 41/88] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:27 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:27.942393 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-e08a891c-130f-4208-87d5-460a6f2f9842 req-36a63426-c19c-478f-bb99-9335b87b5794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ea3f0a-7300-45ed-8778-4ca04699ff84", "tag": "210e9aa1-6c18-46a4-b1f6-904dc4e498d1"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:40:27.953082 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-e08a891c-130f-4208-87d5-460a6f2f9842 req-36a63426-c19c-478f-bb99-9335b87b5794 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:27.953681 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-e08a891c-130f-4208-87d5-460a6f2f9842 req-36a63426-c19c-478f-bb99-9335b87b5794 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:27.981634 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-e08a891c-130f-4208-87d5-460a6f2f9842 req-36a63426-c19c-478f-bb99-9335b87b5794 service nova] Creating event network-changed:210e9aa1-6c18-46a4-b1f6-904dc4e498d1 for instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 on hv-cinder-83769 May 16 17:40:27.987713 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-e08a891c-130f-4208-87d5-460a6f2f9842 req-36a63426-c19c-478f-bb99-9335b87b5794 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049476 May 16 17:40:27.988426 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 48/89] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:40:28.137746 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-afc660ef-20a3-48b2-b9ef-eed1f8ff2a58 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:28.144828 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-afc660ef-20a3-48b2-b9ef-eed1f8ff2a58 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:28.162789 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-afc660ef-20a3-48b2-b9ef-eed1f8ff2a58 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:28.163536 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-afc660ef-20a3-48b2-b9ef-eed1f8ff2a58 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:28.164535 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-afc660ef-20a3-48b2-b9ef-eed1f8ff2a58 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:28.165213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-afc660ef-20a3-48b2-b9ef-eed1f8ff2a58 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:28.188028 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d175109f-dea5-4dcc-8310-7d9d2df91a6a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:28.188945 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d175109f-dea5-4dcc-8310-7d9d2df91a6a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:28.196063 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d175109f-dea5-4dcc-8310-7d9d2df91a6a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:28.196868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d175109f-dea5-4dcc-8310-7d9d2df91a6a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:28.197930 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d175109f-dea5-4dcc-8310-7d9d2df91a6a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:28.198634 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d175109f-dea5-4dcc-8310-7d9d2df91a6a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:28.595374 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-afc660ef-20a3-48b2-b9ef-eed1f8ff2a58 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:28.607037 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-afc660ef-20a3-48b2-b9ef-eed1f8ff2a58 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1365 microversion: 2.1 time: 0.470771 May 16 17:40:28.616661 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 42/90] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:28 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1365 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:40:28.627837 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d175109f-dea5-4dcc-8310-7d9d2df91a6a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:28.637153 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d175109f-dea5-4dcc-8310-7d9d2df91a6a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1313 microversion: 2.1 time: 0.464234 May 16 17:40:28.641788 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 49/91] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:28 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:28.652712 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-fc0fa9ae-4512-4316-999e-c2ae6e746944 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:28.653366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-fc0fa9ae-4512-4316-999e-c2ae6e746944 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:28.662767 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fc0fa9ae-4512-4316-999e-c2ae6e746944 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:28.663222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fc0fa9ae-4512-4316-999e-c2ae6e746944 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:28.667987 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fc0fa9ae-4512-4316-999e-c2ae6e746944 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:28.668494 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fc0fa9ae-4512-4316-999e-c2ae6e746944 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:29.310184 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-fc0fa9ae-4512-4316-999e-c2ae6e746944 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:29.319880 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-fc0fa9ae-4512-4316-999e-c2ae6e746944 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1321 microversion: 2.1 time: 0.671396 May 16 17:40:29.322748 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 43/92] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:28 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1321 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:29.624373 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-c53ee856-16b2-4955-a698-bd69f0418f04 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:29.624970 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-c53ee856-16b2-4955-a698-bd69f0418f04 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:29.632660 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c53ee856-16b2-4955-a698-bd69f0418f04 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:29.634303 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c53ee856-16b2-4955-a698-bd69f0418f04 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:29.635744 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c53ee856-16b2-4955-a698-bd69f0418f04 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:29.636299 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c53ee856-16b2-4955-a698-bd69f0418f04 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:29.656673 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-1ae1f6e1-bf48-401d-8f7e-d40fae17441c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:29.657290 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-1ae1f6e1-bf48-401d-8f7e-d40fae17441c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:29.663751 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1ae1f6e1-bf48-401d-8f7e-d40fae17441c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:29.664537 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1ae1f6e1-bf48-401d-8f7e-d40fae17441c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:29.665737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1ae1f6e1-bf48-401d-8f7e-d40fae17441c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:29.666148 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1ae1f6e1-bf48-401d-8f7e-d40fae17441c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:30.073986 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-1ae1f6e1-bf48-401d-8f7e-d40fae17441c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:30.087748 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-1ae1f6e1-bf48-401d-8f7e-d40fae17441c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1313 microversion: 2.1 time: 0.435296 May 16 17:40:30.088328 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 44/93] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:29 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:40:30.235677 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-c53ee856-16b2-4955-a698-bd69f0418f04 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:30.247140 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-c53ee856-16b2-4955-a698-bd69f0418f04 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1365 microversion: 2.1 time: 0.625871 May 16 17:40:30.247735 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 50/94] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:29 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1365 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:30.340828 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ea4ee72f-9b5a-402f-83da-a550a83f0c9f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:30.342392 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-ea4ee72f-9b5a-402f-83da-a550a83f0c9f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:30.354087 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ea4ee72f-9b5a-402f-83da-a550a83f0c9f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:30.354650 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ea4ee72f-9b5a-402f-83da-a550a83f0c9f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:30.355551 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ea4ee72f-9b5a-402f-83da-a550a83f0c9f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:30.356222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ea4ee72f-9b5a-402f-83da-a550a83f0c9f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:30.512803 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-d3bbaf1d-6ea4-4759-b1ef-1db91f908e92 req-c69aa7dc-e1e9-45a4-8446-67087ee64d59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b033cd6f-aebe-48ae-aefd-f505e6f16bbc", "name": "network-vif-plugged", "status": "completed", "tag": "d9c5c334-51e8-4667-bc89-5b3cf71031cf"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:40:30.526593 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-d3bbaf1d-6ea4-4759-b1ef-1db91f908e92 req-c69aa7dc-e1e9-45a4-8446-67087ee64d59 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:30.534254 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-d3bbaf1d-6ea4-4759-b1ef-1db91f908e92 req-c69aa7dc-e1e9-45a4-8446-67087ee64d59 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:30.558739 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-d3bbaf1d-6ea4-4759-b1ef-1db91f908e92 req-c69aa7dc-e1e9-45a4-8446-67087ee64d59 service nova] Creating event network-vif-plugged:d9c5c334-51e8-4667-bc89-5b3cf71031cf for instance b033cd6f-aebe-48ae-aefd-f505e6f16bbc on hv-cinder-83769 May 16 17:40:30.565063 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-ea4ee72f-9b5a-402f-83da-a550a83f0c9f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:30.567465 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-d3bbaf1d-6ea4-4759-b1ef-1db91f908e92 req-c69aa7dc-e1e9-45a4-8446-67087ee64d59 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058003 May 16 17:40:30.570379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 51/95] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:30.577695 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ea4ee72f-9b5a-402f-83da-a550a83f0c9f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1321 microversion: 2.1 time: 0.241703 May 16 17:40:30.578309 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 45/96] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:30 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:31.111192 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-7dedfdee-88b0-4808-867e-59f17fc82db5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:31.112210 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-7dedfdee-88b0-4808-867e-59f17fc82db5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:31.134290 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7dedfdee-88b0-4808-867e-59f17fc82db5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:31.134784 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7dedfdee-88b0-4808-867e-59f17fc82db5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:31.135641 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7dedfdee-88b0-4808-867e-59f17fc82db5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:31.136080 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7dedfdee-88b0-4808-867e-59f17fc82db5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:31.267036 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b9fd3c26-93be-4ab7-a4b7-2292684198f7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:31.268127 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b9fd3c26-93be-4ab7-a4b7-2292684198f7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:31.276163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b9fd3c26-93be-4ab7-a4b7-2292684198f7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:31.277255 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b9fd3c26-93be-4ab7-a4b7-2292684198f7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:31.290704 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b9fd3c26-93be-4ab7-a4b7-2292684198f7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:31.292013 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b9fd3c26-93be-4ab7-a4b7-2292684198f7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:31.488294 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-7dedfdee-88b0-4808-867e-59f17fc82db5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:31.501966 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-7dedfdee-88b0-4808-867e-59f17fc82db5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1313 microversion: 2.1 time: 0.400216 May 16 17:40:31.512752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 52/97] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:31 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:31.528139 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-b9fd3c26-93be-4ab7-a4b7-2292684198f7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:31.536953 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b9fd3c26-93be-4ab7-a4b7-2292684198f7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1365 microversion: 2.1 time: 0.275901 May 16 17:40:31.548615 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 46/98] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:31 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:40:31.598627 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d8b076eb-ece9-44fb-b109-b1a4985073b4 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:31.599914 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d8b076eb-ece9-44fb-b109-b1a4985073b4 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:31.610909 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d8b076eb-ece9-44fb-b109-b1a4985073b4 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:31.612221 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d8b076eb-ece9-44fb-b109-b1a4985073b4 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:31.615516 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d8b076eb-ece9-44fb-b109-b1a4985073b4 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:31.616247 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d8b076eb-ece9-44fb-b109-b1a4985073b4 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:31.790591 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d8b076eb-ece9-44fb-b109-b1a4985073b4 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:31.798357 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d8b076eb-ece9-44fb-b109-b1a4985073b4 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1321 microversion: 2.1 time: 0.206922 May 16 17:40:31.807810 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 53/99] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:31 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:40:32.520548 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-97676e3e-2d55-4a6c-9b29-64cd48f9fd05 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:32.522204 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-97676e3e-2d55-4a6c-9b29-64cd48f9fd05 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:32.530026 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-97676e3e-2d55-4a6c-9b29-64cd48f9fd05 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:32.531357 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-97676e3e-2d55-4a6c-9b29-64cd48f9fd05 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:32.532841 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-97676e3e-2d55-4a6c-9b29-64cd48f9fd05 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:32.534130 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-97676e3e-2d55-4a6c-9b29-64cd48f9fd05 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:32.557230 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-7a6d4414-2fd1-4e6b-8053-ae6ea51439ec tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:32.557878 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-7a6d4414-2fd1-4e6b-8053-ae6ea51439ec tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:32.569789 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7a6d4414-2fd1-4e6b-8053-ae6ea51439ec tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:32.569789 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7a6d4414-2fd1-4e6b-8053-ae6ea51439ec tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:32.570459 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7a6d4414-2fd1-4e6b-8053-ae6ea51439ec tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:32.570903 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7a6d4414-2fd1-4e6b-8053-ae6ea51439ec tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:32.832092 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-7a6d4414-2fd1-4e6b-8053-ae6ea51439ec tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:32.842984 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-7a6d4414-2fd1-4e6b-8053-ae6ea51439ec tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1365 microversion: 2.1 time: 0.291260 May 16 17:40:32.843533 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-97676e3e-2d55-4a6c-9b29-64cd48f9fd05 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:32.843686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 54/100] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:32 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:40:32.853775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-902b4b58-bf44-4a70-9139-28e765432e9b req-702780df-f8c2-4452-a7d4-5c46c34684d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8ac2f4d-715e-4f43-b3fd-1766c17850b9", "name": "network-vif-plugged", "status": "completed", "tag": "90aff3c1-0c10-404b-852f-cb00af0b6710"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:40:32.856976 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-97676e3e-2d55-4a6c-9b29-64cd48f9fd05 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1500 microversion: 2.1 time: 0.340698 May 16 17:40:32.858073 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 47/101] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:32 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1500 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:32.865436 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-7b37c1d2-9687-4251-9a9a-d3252fdc18c1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:32.866182 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-7b37c1d2-9687-4251-9a9a-d3252fdc18c1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:32.873306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7b37c1d2-9687-4251-9a9a-d3252fdc18c1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:32.874059 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7b37c1d2-9687-4251-9a9a-d3252fdc18c1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:32.875520 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7b37c1d2-9687-4251-9a9a-d3252fdc18c1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:32.876192 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7b37c1d2-9687-4251-9a9a-d3252fdc18c1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:32.894237 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-902b4b58-bf44-4a70-9139-28e765432e9b req-702780df-f8c2-4452-a7d4-5c46c34684d1 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:32.894683 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-902b4b58-bf44-4a70-9139-28e765432e9b req-702780df-f8c2-4452-a7d4-5c46c34684d1 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:32.926750 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-902b4b58-bf44-4a70-9139-28e765432e9b req-702780df-f8c2-4452-a7d4-5c46c34684d1 service nova] Creating event network-vif-plugged:90aff3c1-0c10-404b-852f-cb00af0b6710 for instance d8ac2f4d-715e-4f43-b3fd-1766c17850b9 on hv-cinder-83769 May 16 17:40:32.939994 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-902b4b58-bf44-4a70-9139-28e765432e9b req-702780df-f8c2-4452-a7d4-5c46c34684d1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095231 May 16 17:40:32.940605 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 55/102] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:33.050188 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-7b37c1d2-9687-4251-9a9a-d3252fdc18c1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:33.058913 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-7b37c1d2-9687-4251-9a9a-d3252fdc18c1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1321 microversion: 2.1 time: 0.199473 May 16 17:40:33.059805 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 48/103] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:32 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:33.069967 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-a264c8b8-f6e7-479b-a155-1141fb05d8b4 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1786251692", "imageRef": "782bd628-ef1b-419c-99f5-2c312d1766a6", "flavorRef": "452", "networks": [{"uuid": "fd3dc598-e7d3-40a5-b9f8-1b772bc93fbb"}]}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:40:33.131238 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.network.neutron [None req-a264c8b8-f6e7-479b-a155-1141fb05d8b4 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] validate_networks() for [('fd3dc598-e7d3-40a5-b9f8-1b772bc93fbb', None, None, None, None, None)] {{(pid=128815) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:40:33.673492 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-a264c8b8-f6e7-479b-a155-1141fb05d8b4 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Flavor limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:40:33.674068 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-a264c8b8-f6e7-479b-a155-1141fb05d8b4 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Image limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:40:33.674400 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-a264c8b8-f6e7-479b-a155-1141fb05d8b4 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Flavor pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:40:33.674807 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-a264c8b8-f6e7-479b-a155-1141fb05d8b4 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Image pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:40:33.675215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-a264c8b8-f6e7-479b-a155-1141fb05d8b4 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:40:33.688049 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a264c8b8-f6e7-479b-a155-1141fb05d8b4 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:33.688442 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a264c8b8-f6e7-479b-a155-1141fb05d8b4 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:33.689917 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a264c8b8-f6e7-479b-a155-1141fb05d8b4 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:33.690783 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a264c8b8-f6e7-479b-a155-1141fb05d8b4 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:33.715823 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-a264c8b8-f6e7-479b-a155-1141fb05d8b4 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Getting quotas for project 39e8d3ee6d3e40dfbf0d32c7270a42fa. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:40:33.720700 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-a264c8b8-f6e7-479b-a155-1141fb05d8b4 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Getting quotas for user 4a557548cbc94c33a1d99d694d6b57c0 and project 39e8d3ee6d3e40dfbf0d32c7270a42fa. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:40:33.732550 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a264c8b8-f6e7-479b-a155-1141fb05d8b4 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Going to run 1 instances... {{(pid=128815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:40:33.735643 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a264c8b8-f6e7-479b-a155-1141fb05d8b4 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='782bd628-ef1b-419c-99f5-2c312d1766a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:40:33.792964 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-a264c8b8-f6e7-479b-a155-1141fb05d8b4 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737691 May 16 17:40:33.798877 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 56/104] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:40:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 17:40:33.805443 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-46ced5b0-e80e-4ada-bd29-fd635a10ceab tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:33.806743 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-46ced5b0-e80e-4ada-bd29-fd635a10ceab tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:33.859877 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0f87c22a-c1c6-4c39-b651-70f51a6e610c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:33.860599 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-0f87c22a-c1c6-4c39-b651-70f51a6e610c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:33.873326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0f87c22a-c1c6-4c39-b651-70f51a6e610c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:33.873880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0f87c22a-c1c6-4c39-b651-70f51a6e610c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:33.875078 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0f87c22a-c1c6-4c39-b651-70f51a6e610c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:33.875693 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0f87c22a-c1c6-4c39-b651-70f51a6e610c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:33.949214 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-46ced5b0-e80e-4ada-bd29-fd635a10ceab tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:33.965172 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-46ced5b0-e80e-4ada-bd29-fd635a10ceab tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1214 microversion: 2.1 time: 0.164056 May 16 17:40:33.966057 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 49/105] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:33 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:34.076927 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d2577492-dabf-433e-b8ea-a2231634ff4f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:34.077614 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d2577492-dabf-433e-b8ea-a2231634ff4f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:34.091759 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d2577492-dabf-433e-b8ea-a2231634ff4f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:34.093512 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d2577492-dabf-433e-b8ea-a2231634ff4f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:34.097206 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d2577492-dabf-433e-b8ea-a2231634ff4f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:34.099817 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d2577492-dabf-433e-b8ea-a2231634ff4f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:34.221142 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-0f87c22a-c1c6-4c39-b651-70f51a6e610c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:34.231031 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-0f87c22a-c1c6-4c39-b651-70f51a6e610c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1365 microversion: 2.1 time: 0.375339 May 16 17:40:34.237061 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 57/106] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:33 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1365 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:34.412752 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d2577492-dabf-433e-b8ea-a2231634ff4f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:34.417748 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d2577492-dabf-433e-b8ea-a2231634ff4f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1321 microversion: 2.1 time: 0.345739 May 16 17:40:34.420089 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-544212a5-0ad9-46c6-87aa-ff6c5df0bd0d tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "389c5fd7-3cf4-4ce6-aabb-69930a780788"}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:40:34.420224 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 50/107] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:34 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:40:34.427297 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-544212a5-0ad9-46c6-87aa-ff6c5df0bd0d tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:34.437342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-544212a5-0ad9-46c6-87aa-ff6c5df0bd0d tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:34.438941 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-544212a5-0ad9-46c6-87aa-ff6c5df0bd0d tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:34.440057 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-544212a5-0ad9-46c6-87aa-ff6c5df0bd0d tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:34.440827 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-544212a5-0ad9-46c6-87aa-ff6c5df0bd0d tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:34.956908 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-e042af13-d466-44df-b734-c29112d10e99 req-2118e5b2-aaed-4b80-992d-0fb395e42f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ea3f0a-7300-45ed-8778-4ca04699ff84", "name": "network-vif-plugged", "status": "completed", "tag": "210e9aa1-6c18-46a4-b1f6-904dc4e498d1"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:40:34.980386 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-e042af13-d466-44df-b734-c29112d10e99 req-2118e5b2-aaed-4b80-992d-0fb395e42f80 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:34.982066 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-e042af13-d466-44df-b734-c29112d10e99 req-2118e5b2-aaed-4b80-992d-0fb395e42f80 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:35.012783 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-e042af13-d466-44df-b734-c29112d10e99 req-2118e5b2-aaed-4b80-992d-0fb395e42f80 service nova] Creating event network-vif-plugged:210e9aa1-6c18-46a4-b1f6-904dc4e498d1 for instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 on hv-cinder-83769 May 16 17:40:35.020129 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-e042af13-d466-44df-b734-c29112d10e99 req-2118e5b2-aaed-4b80-992d-0fb395e42f80 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066940 May 16 17:40:35.020903 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 51/108] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:35.027260 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-7e4e49ff-243c-41d1-8128-7c99ce35307e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:35.027953 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-7e4e49ff-243c-41d1-8128-7c99ce35307e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:35.035322 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7e4e49ff-243c-41d1-8128-7c99ce35307e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:35.036079 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7e4e49ff-243c-41d1-8128-7c99ce35307e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:35.037799 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7e4e49ff-243c-41d1-8128-7c99ce35307e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:35.038450 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7e4e49ff-243c-41d1-8128-7c99ce35307e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:35.190780 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-7e4e49ff-243c-41d1-8128-7c99ce35307e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:35.201740 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-7e4e49ff-243c-41d1-8128-7c99ce35307e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1218 microversion: 2.1 time: 0.178756 May 16 17:40:35.212986 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 52/109] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:35 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1218 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:35.259527 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c5a3cd07-e13f-498b-9989-046b8fd3498a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:35.260137 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-c5a3cd07-e13f-498b-9989-046b8fd3498a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:35.279389 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c5a3cd07-e13f-498b-9989-046b8fd3498a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:35.279841 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c5a3cd07-e13f-498b-9989-046b8fd3498a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:35.285051 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c5a3cd07-e13f-498b-9989-046b8fd3498a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:35.285753 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c5a3cd07-e13f-498b-9989-046b8fd3498a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:35.441907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-544212a5-0ad9-46c6-87aa-ff6c5df0bd0d tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "POST /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.025657 May 16 17:40:35.447262 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 58/110] 10.222.0.58 () {60 vars in 1322 bytes} [Mon May 16 17:40:34 2022] POST /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32/os-volume_attachments => generated 194 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:40:35.455883 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-24864cc6-ba12-4403-94c0-6082c2a62388 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:35.456607 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-24864cc6-ba12-4403-94c0-6082c2a62388 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:35.469926 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-24864cc6-ba12-4403-94c0-6082c2a62388 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:35.470385 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-24864cc6-ba12-4403-94c0-6082c2a62388 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:35.471173 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-24864cc6-ba12-4403-94c0-6082c2a62388 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:35.471606 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-24864cc6-ba12-4403-94c0-6082c2a62388 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:35.774562 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-24864cc6-ba12-4403-94c0-6082c2a62388 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:35.777668 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-c5a3cd07-e13f-498b-9989-046b8fd3498a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:35.783568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-24864cc6-ba12-4403-94c0-6082c2a62388 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1515 microversion: 2.1 time: 0.336191 May 16 17:40:35.784470 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 59/111] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:35 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1515 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:35.785214 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-c5a3cd07-e13f-498b-9989-046b8fd3498a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1365 microversion: 2.1 time: 0.535078 May 16 17:40:35.787022 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 53/112] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:35 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1365 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:35.801852 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f6803914-78cd-42e1-9596-f8d6b052f637 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:40:35.803356 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-f6803914-78cd-42e1-9596-f8d6b052f637 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:35.809684 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f6803914-78cd-42e1-9596-f8d6b052f637 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:35.810318 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f6803914-78cd-42e1-9596-f8d6b052f637 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:35.811469 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f6803914-78cd-42e1-9596-f8d6b052f637 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:35.811903 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f6803914-78cd-42e1-9596-f8d6b052f637 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:35.842878 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.objects.instance [None req-f6803914-78cd-42e1-9596-f8d6b052f637 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lazy-loading 'flavor' on Instance uuid d8ac2f4d-715e-4f43-b3fd-1766c17850b9 {{(pid=128815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:40:35.972055 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f6803914-78cd-42e1-9596-f8d6b052f637 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "POST /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9/action" status: 200 len: 32 microversion: 2.1 time: 0.174323 May 16 17:40:35.972784 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 60/113] 10.222.0.58 () {60 vars in 1277 bytes} [Mon May 16 17:40:35 2022] POST /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 17:40:35.981949 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b7fa6ef8-abe6-456b-ada0-a3ba624a5c5b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:35.983167 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b7fa6ef8-abe6-456b-ada0-a3ba624a5c5b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:35.989690 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b7fa6ef8-abe6-456b-ada0-a3ba624a5c5b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:35.990392 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b7fa6ef8-abe6-456b-ada0-a3ba624a5c5b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:35.991201 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b7fa6ef8-abe6-456b-ada0-a3ba624a5c5b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:35.991720 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b7fa6ef8-abe6-456b-ada0-a3ba624a5c5b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:36.146551 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-b7fa6ef8-abe6-456b-ada0-a3ba624a5c5b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:36.157734 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b7fa6ef8-abe6-456b-ada0-a3ba624a5c5b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.179441 May 16 17:40:36.159450 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 54/114] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:35 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:36.219908 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d772d5c9-fe42-4e93-80f6-b37cdd072890 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:36.220905 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d772d5c9-fe42-4e93-80f6-b37cdd072890 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:36.229016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d772d5c9-fe42-4e93-80f6-b37cdd072890 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:36.229464 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d772d5c9-fe42-4e93-80f6-b37cdd072890 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:36.230255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d772d5c9-fe42-4e93-80f6-b37cdd072890 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:36.230738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d772d5c9-fe42-4e93-80f6-b37cdd072890 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:36.320305 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d772d5c9-fe42-4e93-80f6-b37cdd072890 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:36.329592 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d772d5c9-fe42-4e93-80f6-b37cdd072890 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1274 microversion: 2.1 time: 0.114114 May 16 17:40:36.330926 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 61/115] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:36 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1274 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:36.804293 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9dfa0eea-3856-4990-9a19-4539cf59a0ef tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:36.805054 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-9dfa0eea-3856-4990-9a19-4539cf59a0ef tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:36.812177 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9dfa0eea-3856-4990-9a19-4539cf59a0ef tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:36.812613 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9dfa0eea-3856-4990-9a19-4539cf59a0ef tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:36.813602 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9dfa0eea-3856-4990-9a19-4539cf59a0ef tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:36.814227 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9dfa0eea-3856-4990-9a19-4539cf59a0ef tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:36.953694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9dfa0eea-3856-4990-9a19-4539cf59a0ef tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:36.961648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-9dfa0eea-3856-4990-9a19-4539cf59a0ef tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1365 microversion: 2.1 time: 0.162611 May 16 17:40:36.968208 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 55/116] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:36 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:37.175801 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-30ad8160-be3d-453c-a06c-5acf0adceaf3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:37.176594 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-30ad8160-be3d-453c-a06c-5acf0adceaf3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:37.182412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-30ad8160-be3d-453c-a06c-5acf0adceaf3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:37.182864 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-30ad8160-be3d-453c-a06c-5acf0adceaf3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:37.183627 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-30ad8160-be3d-453c-a06c-5acf0adceaf3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:37.184059 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-30ad8160-be3d-453c-a06c-5acf0adceaf3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:37.334964 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-30ad8160-be3d-453c-a06c-5acf0adceaf3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:37.350378 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d78931d2-5330-493e-a157-ecacfb93b76c tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:37.351293 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d78931d2-5330-493e-a157-ecacfb93b76c tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:37.358459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d78931d2-5330-493e-a157-ecacfb93b76c tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:37.359122 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d78931d2-5330-493e-a157-ecacfb93b76c tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:37.360608 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d78931d2-5330-493e-a157-ecacfb93b76c tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:37.361379 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d78931d2-5330-493e-a157-ecacfb93b76c tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:37.361689 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-30ad8160-be3d-453c-a06c-5acf0adceaf3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.188596 May 16 17:40:37.362514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 62/117] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:37 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:37.447618 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d78931d2-5330-493e-a157-ecacfb93b76c tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:37.457948 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d78931d2-5330-493e-a157-ecacfb93b76c tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1274 microversion: 2.1 time: 0.112827 May 16 17:40:37.458668 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 56/118] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:37 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:40:37.978222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-3a54b2d3-3621-44b7-9aef-4662ec32ce50 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:37.978834 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-3a54b2d3-3621-44b7-9aef-4662ec32ce50 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:37.984739 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3a54b2d3-3621-44b7-9aef-4662ec32ce50 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:37.985409 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3a54b2d3-3621-44b7-9aef-4662ec32ce50 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:37.986172 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3a54b2d3-3621-44b7-9aef-4662ec32ce50 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:37.986823 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3a54b2d3-3621-44b7-9aef-4662ec32ce50 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:38.116735 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3a54b2d3-3621-44b7-9aef-4662ec32ce50 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:38.123996 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-3a54b2d3-3621-44b7-9aef-4662ec32ce50 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1365 microversion: 2.1 time: 0.149609 May 16 17:40:38.129610 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 63/119] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:37 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:38.378446 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-72f19649-da22-46bf-a244-84fc22dca92d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:38.379031 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-72f19649-da22-46bf-a244-84fc22dca92d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:38.384922 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-72f19649-da22-46bf-a244-84fc22dca92d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:38.385362 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-72f19649-da22-46bf-a244-84fc22dca92d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:38.386366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-72f19649-da22-46bf-a244-84fc22dca92d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:38.386779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-72f19649-da22-46bf-a244-84fc22dca92d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:38.475683 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d065df57-53ec-4005-b7e1-d47d060e48a5 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:38.477906 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d065df57-53ec-4005-b7e1-d47d060e48a5 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:38.484293 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d065df57-53ec-4005-b7e1-d47d060e48a5 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:38.485366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d065df57-53ec-4005-b7e1-d47d060e48a5 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:38.486515 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d065df57-53ec-4005-b7e1-d47d060e48a5 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:38.486948 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d065df57-53ec-4005-b7e1-d47d060e48a5 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:38.615540 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d065df57-53ec-4005-b7e1-d47d060e48a5 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:38.631695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d065df57-53ec-4005-b7e1-d47d060e48a5 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1274 microversion: 2.1 time: 0.159933 May 16 17:40:38.633077 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 64/120] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:38 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1274 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:38.651286 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-72f19649-da22-46bf-a244-84fc22dca92d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:38.694006 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-72f19649-da22-46bf-a244-84fc22dca92d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.289922 May 16 17:40:38.703817 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 57/121] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:38 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:39.140794 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f1cf49f4-da82-4c1a-9944-0fe128d524db tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:39.141978 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-f1cf49f4-da82-4c1a-9944-0fe128d524db tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:39.150868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f1cf49f4-da82-4c1a-9944-0fe128d524db tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:39.151302 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f1cf49f4-da82-4c1a-9944-0fe128d524db tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:39.154568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f1cf49f4-da82-4c1a-9944-0fe128d524db tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:39.155018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f1cf49f4-da82-4c1a-9944-0fe128d524db tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:39.354421 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-f1cf49f4-da82-4c1a-9944-0fe128d524db tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:39.362569 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f1cf49f4-da82-4c1a-9944-0fe128d524db tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1365 microversion: 2.1 time: 0.225339 May 16 17:40:39.363288 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 65/122] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:39 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:39.653327 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9695735a-1461-41e7-a0f6-eb045663bfae tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:39.654095 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-9695735a-1461-41e7-a0f6-eb045663bfae tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:39.670712 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9695735a-1461-41e7-a0f6-eb045663bfae tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:39.671157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9695735a-1461-41e7-a0f6-eb045663bfae tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:39.671943 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9695735a-1461-41e7-a0f6-eb045663bfae tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:39.672375 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9695735a-1461-41e7-a0f6-eb045663bfae tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:39.712084 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-a4f007fa-be78-46e6-af49-40b40e492a44 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:39.713774 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a4f007fa-be78-46e6-af49-40b40e492a44 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:39.721219 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a4f007fa-be78-46e6-af49-40b40e492a44 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:39.721720 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a4f007fa-be78-46e6-af49-40b40e492a44 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:39.722598 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a4f007fa-be78-46e6-af49-40b40e492a44 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:39.724011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a4f007fa-be78-46e6-af49-40b40e492a44 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:40.035087 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9695735a-1461-41e7-a0f6-eb045663bfae tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:40.042198 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-a4f007fa-be78-46e6-af49-40b40e492a44 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:40.043720 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-9695735a-1461-41e7-a0f6-eb045663bfae tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.396559 May 16 17:40:40.044304 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 58/123] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:39 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:40.050691 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-a4f007fa-be78-46e6-af49-40b40e492a44 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.343061 May 16 17:40:40.060088 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 66/124] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:39 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:40.379797 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-32387fdb-7064-45cb-bee8-77d28655bdda tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:40.380395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-32387fdb-7064-45cb-bee8-77d28655bdda tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:40.388278 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-32387fdb-7064-45cb-bee8-77d28655bdda tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:40.388278 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-32387fdb-7064-45cb-bee8-77d28655bdda tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:40.388278 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-32387fdb-7064-45cb-bee8-77d28655bdda tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:40.388278 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-32387fdb-7064-45cb-bee8-77d28655bdda tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:40.536552 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-32387fdb-7064-45cb-bee8-77d28655bdda tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:40.545133 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-32387fdb-7064-45cb-bee8-77d28655bdda tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1365 microversion: 2.1 time: 0.169230 May 16 17:40:40.546141 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 59/125] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:40 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:41.060864 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d859306f-6db8-411a-99a9-cb13c1d46c3f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:41.061757 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d859306f-6db8-411a-99a9-cb13c1d46c3f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:41.068083 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-55f193fc-132a-4696-9d19-6b8edd203b9d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:41.068692 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-55f193fc-132a-4696-9d19-6b8edd203b9d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:41.069583 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d859306f-6db8-411a-99a9-cb13c1d46c3f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:41.070300 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d859306f-6db8-411a-99a9-cb13c1d46c3f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:41.071367 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d859306f-6db8-411a-99a9-cb13c1d46c3f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:41.072174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d859306f-6db8-411a-99a9-cb13c1d46c3f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:41.075179 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-55f193fc-132a-4696-9d19-6b8edd203b9d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:41.075630 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-55f193fc-132a-4696-9d19-6b8edd203b9d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:41.076612 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-55f193fc-132a-4696-9d19-6b8edd203b9d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:41.077206 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-55f193fc-132a-4696-9d19-6b8edd203b9d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:41.288125 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d859306f-6db8-411a-99a9-cb13c1d46c3f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:41.296987 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d859306f-6db8-411a-99a9-cb13c1d46c3f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.239922 May 16 17:40:41.297592 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 67/126] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:41 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:41.297799 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-55f193fc-132a-4696-9d19-6b8edd203b9d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:41.305125 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-55f193fc-132a-4696-9d19-6b8edd203b9d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.241525 May 16 17:40:41.314878 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 60/127] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:41 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:40:41.568035 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ceaeac94-196e-4832-97dc-ba3cb2b30273 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:41.569332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ceaeac94-196e-4832-97dc-ba3cb2b30273 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:41.585373 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ceaeac94-196e-4832-97dc-ba3cb2b30273 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:41.587397 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ceaeac94-196e-4832-97dc-ba3cb2b30273 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:41.588353 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ceaeac94-196e-4832-97dc-ba3cb2b30273 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:41.588961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ceaeac94-196e-4832-97dc-ba3cb2b30273 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:41.792284 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ceaeac94-196e-4832-97dc-ba3cb2b30273 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:41.804693 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ceaeac94-196e-4832-97dc-ba3cb2b30273 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1365 microversion: 2.1 time: 0.241890 May 16 17:40:41.808219 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 68/128] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:41 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:42.319750 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-82928c62-2c04-4dfc-9a3a-544462ad128f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:42.320491 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-82928c62-2c04-4dfc-9a3a-544462ad128f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:42.321165 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-92346526-7b9c-4f96-b8b5-37c06f90cea7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:42.322007 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-92346526-7b9c-4f96-b8b5-37c06f90cea7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:42.330160 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-92346526-7b9c-4f96-b8b5-37c06f90cea7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:42.332912 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-82928c62-2c04-4dfc-9a3a-544462ad128f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:42.333165 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-92346526-7b9c-4f96-b8b5-37c06f90cea7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:42.335376 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-82928c62-2c04-4dfc-9a3a-544462ad128f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:42.336922 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-82928c62-2c04-4dfc-9a3a-544462ad128f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:42.337594 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-92346526-7b9c-4f96-b8b5-37c06f90cea7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:42.339064 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-92346526-7b9c-4f96-b8b5-37c06f90cea7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:42.342738 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-82928c62-2c04-4dfc-9a3a-544462ad128f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:42.813007 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-92346526-7b9c-4f96-b8b5-37c06f90cea7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:42.821003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-82928c62-2c04-4dfc-9a3a-544462ad128f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:42.823319 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-92346526-7b9c-4f96-b8b5-37c06f90cea7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.506030 May 16 17:40:42.824310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 69/129] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:42 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:42.828387 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-82928c62-2c04-4dfc-9a3a-544462ad128f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.516002 May 16 17:40:42.828954 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 61/130] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:42 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:42.831404 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-ef9c6bb0-8d69-47f4-bacd-e9ccafc0cfd3 req-29ca39c6-0813-4270-bf87-be070befb803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa888899-08da-449a-bfec-44545e740ca8", "tag": "4008578d-3079-4492-b51b-6afa7663b028"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:40:42.837702 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-94f86f66-ec4b-4ecd-97ca-b52b7c38b9c4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:42.838608 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-94f86f66-ec4b-4ecd-97ca-b52b7c38b9c4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:42.845287 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-94f86f66-ec4b-4ecd-97ca-b52b7c38b9c4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:42.846068 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-94f86f66-ec4b-4ecd-97ca-b52b7c38b9c4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:42.847036 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-94f86f66-ec4b-4ecd-97ca-b52b7c38b9c4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:42.847742 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-94f86f66-ec4b-4ecd-97ca-b52b7c38b9c4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:42.848345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-ef9c6bb0-8d69-47f4-bacd-e9ccafc0cfd3 req-29ca39c6-0813-4270-bf87-be070befb803 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:42.848915 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-ef9c6bb0-8d69-47f4-bacd-e9ccafc0cfd3 req-29ca39c6-0813-4270-bf87-be070befb803 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:42.862333 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-ef9c6bb0-8d69-47f4-bacd-e9ccafc0cfd3 req-29ca39c6-0813-4270-bf87-be070befb803 service nova] Creating event network-changed:4008578d-3079-4492-b51b-6afa7663b028 for instance fa888899-08da-449a-bfec-44545e740ca8 on hv-cinder-83769 May 16 17:40:42.869959 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-ef9c6bb0-8d69-47f4-bacd-e9ccafc0cfd3 req-29ca39c6-0813-4270-bf87-be070befb803 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044097 May 16 17:40:42.871234 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 70/131] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:42.984194 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-94f86f66-ec4b-4ecd-97ca-b52b7c38b9c4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:42.991532 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-94f86f66-ec4b-4ecd-97ca-b52b7c38b9c4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1365 microversion: 2.1 time: 0.161607 May 16 17:40:42.992105 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 62/132] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:42 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:43.844658 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-c7128d27-0403-430d-99c1-8575e31ff6cc tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:43.845583 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-c7128d27-0403-430d-99c1-8575e31ff6cc tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:43.850530 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a93f6962-a008-4e68-ad34-271887977a99 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:43.851393 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a93f6962-a008-4e68-ad34-271887977a99 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:43.852244 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c7128d27-0403-430d-99c1-8575e31ff6cc tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:43.852687 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c7128d27-0403-430d-99c1-8575e31ff6cc tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:43.853409 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c7128d27-0403-430d-99c1-8575e31ff6cc tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:43.854053 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c7128d27-0403-430d-99c1-8575e31ff6cc tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:43.858410 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a93f6962-a008-4e68-ad34-271887977a99 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:43.858986 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a93f6962-a008-4e68-ad34-271887977a99 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:43.859812 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a93f6962-a008-4e68-ad34-271887977a99 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:43.860336 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a93f6962-a008-4e68-ad34-271887977a99 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:44.059811 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-c7128d27-0403-430d-99c1-8575e31ff6cc tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:44.072986 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-a93f6962-a008-4e68-ad34-271887977a99 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:44.078131 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-c7128d27-0403-430d-99c1-8575e31ff6cc tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.237477 May 16 17:40:44.078640 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 71/133] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:43 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:44.083199 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-9a97a197-663e-401c-b583-a909b1dabcc4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:44.083785 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-9a97a197-663e-401c-b583-a909b1dabcc4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:44.089899 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a93f6962-a008-4e68-ad34-271887977a99 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.243292 May 16 17:40:44.090472 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 63/134] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:43 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:44.104378 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9a97a197-663e-401c-b583-a909b1dabcc4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:44.104378 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9a97a197-663e-401c-b583-a909b1dabcc4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:44.105101 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9a97a197-663e-401c-b583-a909b1dabcc4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:44.105632 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9a97a197-663e-401c-b583-a909b1dabcc4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:44.244114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-9a97a197-663e-401c-b583-a909b1dabcc4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:44.251578 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-9a97a197-663e-401c-b583-a909b1dabcc4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1365 microversion: 2.1 time: 0.171974 May 16 17:40:44.252142 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 72/135] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:44 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:45.095939 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b612c17b-d7a7-47d5-9658-46ff228a2a62 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:45.096718 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b612c17b-d7a7-47d5-9658-46ff228a2a62 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:45.103170 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b612c17b-d7a7-47d5-9658-46ff228a2a62 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:45.103691 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b612c17b-d7a7-47d5-9658-46ff228a2a62 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:45.105214 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b612c17b-d7a7-47d5-9658-46ff228a2a62 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:45.105744 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b612c17b-d7a7-47d5-9658-46ff228a2a62 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:45.107443 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-58838302-06e5-4133-b1da-a1fa24f4a399 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:45.108057 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-58838302-06e5-4133-b1da-a1fa24f4a399 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:45.116947 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-58838302-06e5-4133-b1da-a1fa24f4a399 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:45.117677 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-58838302-06e5-4133-b1da-a1fa24f4a399 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:45.118622 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-58838302-06e5-4133-b1da-a1fa24f4a399 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:45.119203 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-58838302-06e5-4133-b1da-a1fa24f4a399 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:45.499959 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-58838302-06e5-4133-b1da-a1fa24f4a399 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:45.507811 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-58838302-06e5-4133-b1da-a1fa24f4a399 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.405062 May 16 17:40:45.508658 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 73/136] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:45 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:45.517423 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-b612c17b-d7a7-47d5-9658-46ff228a2a62 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:45.523886 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-09f6e111-cbe8-4c5f-9f03-c380fa40aa72 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:45.524856 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-09f6e111-cbe8-4c5f-9f03-c380fa40aa72 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:45.531562 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-09f6e111-cbe8-4c5f-9f03-c380fa40aa72 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:45.532226 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-09f6e111-cbe8-4c5f-9f03-c380fa40aa72 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:45.533267 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-09f6e111-cbe8-4c5f-9f03-c380fa40aa72 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:45.534010 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-09f6e111-cbe8-4c5f-9f03-c380fa40aa72 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:45.553345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b612c17b-d7a7-47d5-9658-46ff228a2a62 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.461429 May 16 17:40:45.555784 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 64/137] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:45 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:45.756415 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-09f6e111-cbe8-4c5f-9f03-c380fa40aa72 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:45.768866 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-09f6e111-cbe8-4c5f-9f03-c380fa40aa72 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1555 microversion: 2.1 time: 0.246749 May 16 17:40:45.769667 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 74/138] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:45 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1555 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:45.790225 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-0e9ed353-20dc-4aa2-b93c-51d51d1c0647 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:45.791307 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-0e9ed353-20dc-4aa2-b93c-51d51d1c0647 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:45.799823 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0e9ed353-20dc-4aa2-b93c-51d51d1c0647 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:45.800835 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0e9ed353-20dc-4aa2-b93c-51d51d1c0647 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:45.802639 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0e9ed353-20dc-4aa2-b93c-51d51d1c0647 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:45.803804 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0e9ed353-20dc-4aa2-b93c-51d51d1c0647 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:45.990971 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-0e9ed353-20dc-4aa2-b93c-51d51d1c0647 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.205183 May 16 17:40:45.991573 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 65/139] 10.222.0.58 () {58 vars in 1274 bytes} [Mon May 16 17:40:45 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-interface => generated 285 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:46.527926 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-82f2fe61-987f-40f4-b4c9-77cff93d0322 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:46.534115 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-82f2fe61-987f-40f4-b4c9-77cff93d0322 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:46.541225 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-82f2fe61-987f-40f4-b4c9-77cff93d0322 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:46.541711 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-82f2fe61-987f-40f4-b4c9-77cff93d0322 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:46.542590 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-82f2fe61-987f-40f4-b4c9-77cff93d0322 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:46.543077 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-82f2fe61-987f-40f4-b4c9-77cff93d0322 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:46.575490 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4c7ba7fd-df94-4040-9cb2-33772def2865 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:46.576243 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4c7ba7fd-df94-4040-9cb2-33772def2865 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:46.594342 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4c7ba7fd-df94-4040-9cb2-33772def2865 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:46.594784 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4c7ba7fd-df94-4040-9cb2-33772def2865 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:46.596981 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4c7ba7fd-df94-4040-9cb2-33772def2865 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:46.597422 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4c7ba7fd-df94-4040-9cb2-33772def2865 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:47.193422 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-82f2fe61-987f-40f4-b4c9-77cff93d0322 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:47.203774 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-82f2fe61-987f-40f4-b4c9-77cff93d0322 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.681845 May 16 17:40:47.204353 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 75/140] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:46 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:47.229679 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-4c7ba7fd-df94-4040-9cb2-33772def2865 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:47.237877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4c7ba7fd-df94-4040-9cb2-33772def2865 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.666033 May 16 17:40:47.238614 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 66/141] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:46 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:47.693489 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-57ce8c50-0348-4420-82aa-1878aa674821 req-d1bbed26-0ee2-40ff-a0c0-272246414584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ea3f0a-7300-45ed-8778-4ca04699ff84", "tag": "210e9aa1-6c18-46a4-b1f6-904dc4e498d1"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:40:47.706722 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-57ce8c50-0348-4420-82aa-1878aa674821 req-d1bbed26-0ee2-40ff-a0c0-272246414584 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:47.707227 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-57ce8c50-0348-4420-82aa-1878aa674821 req-d1bbed26-0ee2-40ff-a0c0-272246414584 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:47.718959 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-57ce8c50-0348-4420-82aa-1878aa674821 req-d1bbed26-0ee2-40ff-a0c0-272246414584 service nova] Creating event network-changed:210e9aa1-6c18-46a4-b1f6-904dc4e498d1 for instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 on hv-cinder-83769 May 16 17:40:47.724881 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-57ce8c50-0348-4420-82aa-1878aa674821 req-d1bbed26-0ee2-40ff-a0c0-272246414584 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035315 May 16 17:40:47.725586 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 76/142] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:48.220839 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b2de7ea0-7a86-4b08-b4b8-9fade7e7a8a3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:48.222994 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b2de7ea0-7a86-4b08-b4b8-9fade7e7a8a3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:48.234850 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b2de7ea0-7a86-4b08-b4b8-9fade7e7a8a3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:48.235606 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b2de7ea0-7a86-4b08-b4b8-9fade7e7a8a3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:48.238643 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b2de7ea0-7a86-4b08-b4b8-9fade7e7a8a3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:48.239288 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b2de7ea0-7a86-4b08-b4b8-9fade7e7a8a3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:48.256009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f1766c5b-82a0-405d-9081-4201efa66d9a tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:48.257107 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-f1766c5b-82a0-405d-9081-4201efa66d9a tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:48.266082 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f1766c5b-82a0-405d-9081-4201efa66d9a tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:48.266532 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f1766c5b-82a0-405d-9081-4201efa66d9a tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:48.267305 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f1766c5b-82a0-405d-9081-4201efa66d9a tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:48.271108 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f1766c5b-82a0-405d-9081-4201efa66d9a tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:48.486844 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-b2de7ea0-7a86-4b08-b4b8-9fade7e7a8a3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:48.494400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b2de7ea0-7a86-4b08-b4b8-9fade7e7a8a3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.277825 May 16 17:40:48.494523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-f1766c5b-82a0-405d-9081-4201efa66d9a tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:48.494972 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 67/143] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:48 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:48.503694 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f1766c5b-82a0-405d-9081-4201efa66d9a tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.252165 May 16 17:40:48.504477 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 77/144] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:48 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:49.511773 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-2a3420ae-6a40-47a8-8e26-5baecde4e7dc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:49.512520 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-2a3420ae-6a40-47a8-8e26-5baecde4e7dc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:49.519407 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2a3420ae-6a40-47a8-8e26-5baecde4e7dc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:49.519824 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2a3420ae-6a40-47a8-8e26-5baecde4e7dc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:49.520630 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2a3420ae-6a40-47a8-8e26-5baecde4e7dc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:49.520828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-2d1258b4-a8e8-4cfa-9fe8-7b6cf381dde8 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:49.521311 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2a3420ae-6a40-47a8-8e26-5baecde4e7dc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:49.522108 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-2d1258b4-a8e8-4cfa-9fe8-7b6cf381dde8 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:49.529267 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2d1258b4-a8e8-4cfa-9fe8-7b6cf381dde8 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:49.529769 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2d1258b4-a8e8-4cfa-9fe8-7b6cf381dde8 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:49.530534 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2d1258b4-a8e8-4cfa-9fe8-7b6cf381dde8 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:49.530946 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2d1258b4-a8e8-4cfa-9fe8-7b6cf381dde8 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:49.721095 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-2a3420ae-6a40-47a8-8e26-5baecde4e7dc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:49.725470 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-2d1258b4-a8e8-4cfa-9fe8-7b6cf381dde8 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:49.731443 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-2a3420ae-6a40-47a8-8e26-5baecde4e7dc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.223236 May 16 17:40:49.732490 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 68/145] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:49 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:49.736051 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-2d1258b4-a8e8-4cfa-9fe8-7b6cf381dde8 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.219457 May 16 17:40:49.736613 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 78/146] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:49 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:50.750543 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-77c5c015-cd5d-447a-80ae-74607c2dc321 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:50.751140 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-77c5c015-cd5d-447a-80ae-74607c2dc321 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:50.753819 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-6fbe0fce-1661-40ce-aab3-2cde0828bd3d tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:50.754527 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-6fbe0fce-1661-40ce-aab3-2cde0828bd3d tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:50.757958 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-77c5c015-cd5d-447a-80ae-74607c2dc321 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:50.758402 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-77c5c015-cd5d-447a-80ae-74607c2dc321 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:50.759161 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-77c5c015-cd5d-447a-80ae-74607c2dc321 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:50.759586 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-77c5c015-cd5d-447a-80ae-74607c2dc321 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:50.762231 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6fbe0fce-1661-40ce-aab3-2cde0828bd3d tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:50.764436 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6fbe0fce-1661-40ce-aab3-2cde0828bd3d tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:50.765334 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6fbe0fce-1661-40ce-aab3-2cde0828bd3d tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:50.778158 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6fbe0fce-1661-40ce-aab3-2cde0828bd3d tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:50.976038 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-77c5c015-cd5d-447a-80ae-74607c2dc321 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:50.985323 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-77c5c015-cd5d-447a-80ae-74607c2dc321 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.239005 May 16 17:40:50.986053 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 69/147] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:50 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:51.044169 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-6fbe0fce-1661-40ce-aab3-2cde0828bd3d tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:51.053411 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-6fbe0fce-1661-40ce-aab3-2cde0828bd3d tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.303803 May 16 17:40:51.054049 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 79/148] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:50 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:52.003200 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-08b50290-c757-454f-9e2a-c12084669baa tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:52.004639 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-08b50290-c757-454f-9e2a-c12084669baa tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:52.017608 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-08b50290-c757-454f-9e2a-c12084669baa tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:52.017608 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-08b50290-c757-454f-9e2a-c12084669baa tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:52.017608 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-08b50290-c757-454f-9e2a-c12084669baa tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:52.017608 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-08b50290-c757-454f-9e2a-c12084669baa tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:52.070604 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5e41c31b-81e3-4945-9d34-d1d25387f8c2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:52.071193 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-5e41c31b-81e3-4945-9d34-d1d25387f8c2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:52.082589 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5e41c31b-81e3-4945-9d34-d1d25387f8c2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:52.083040 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5e41c31b-81e3-4945-9d34-d1d25387f8c2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:52.083813 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5e41c31b-81e3-4945-9d34-d1d25387f8c2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:52.088346 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5e41c31b-81e3-4945-9d34-d1d25387f8c2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:52.228333 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-08b50290-c757-454f-9e2a-c12084669baa tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:52.237890 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-08b50290-c757-454f-9e2a-c12084669baa tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.238883 May 16 17:40:52.241650 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 70/149] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:51 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:52.399802 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-5e41c31b-81e3-4945-9d34-d1d25387f8c2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:52.425696 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-5e41c31b-81e3-4945-9d34-d1d25387f8c2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.357552 May 16 17:40:52.426766 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 80/150] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:52 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:40:53.257916 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d2ffeda1-530f-4097-bc0c-6710a2784566 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:53.258768 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d2ffeda1-530f-4097-bc0c-6710a2784566 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:53.265066 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d2ffeda1-530f-4097-bc0c-6710a2784566 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:53.265604 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d2ffeda1-530f-4097-bc0c-6710a2784566 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:53.266521 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d2ffeda1-530f-4097-bc0c-6710a2784566 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:53.266809 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d2ffeda1-530f-4097-bc0c-6710a2784566 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:53.440026 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d2ffeda1-530f-4097-bc0c-6710a2784566 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:53.443046 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-2f4f496b-3ee1-499c-b3eb-2b313fa84542 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:53.443700 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-2f4f496b-3ee1-499c-b3eb-2b313fa84542 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:53.448514 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d2ffeda1-530f-4097-bc0c-6710a2784566 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.194857 May 16 17:40:53.457812 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2f4f496b-3ee1-499c-b3eb-2b313fa84542 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:53.457812 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2f4f496b-3ee1-499c-b3eb-2b313fa84542 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:53.457812 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2f4f496b-3ee1-499c-b3eb-2b313fa84542 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:53.457812 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2f4f496b-3ee1-499c-b3eb-2b313fa84542 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:53.458701 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 71/151] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:53 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:53.642420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-2f4f496b-3ee1-499c-b3eb-2b313fa84542 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:53.650894 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-2f4f496b-3ee1-499c-b3eb-2b313fa84542 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.212759 May 16 17:40:53.660184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 81/152] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:53 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:40:54.467813 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-fa3d71de-8842-4f0d-9850-01903dace453 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:54.469053 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-fa3d71de-8842-4f0d-9850-01903dace453 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:54.475064 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fa3d71de-8842-4f0d-9850-01903dace453 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:54.475505 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fa3d71de-8842-4f0d-9850-01903dace453 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:54.476422 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fa3d71de-8842-4f0d-9850-01903dace453 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:54.476799 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fa3d71de-8842-4f0d-9850-01903dace453 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:54.609392 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-fa3d71de-8842-4f0d-9850-01903dace453 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:54.617142 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-fa3d71de-8842-4f0d-9850-01903dace453 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.154403 May 16 17:40:54.617862 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 72/153] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:54 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:40:54.667919 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-7209820b-d9fe-4636-862c-8b8b4a486283 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:54.669214 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-7209820b-d9fe-4636-862c-8b8b4a486283 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:54.676157 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7209820b-d9fe-4636-862c-8b8b4a486283 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:54.676599 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7209820b-d9fe-4636-862c-8b8b4a486283 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:54.677749 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7209820b-d9fe-4636-862c-8b8b4a486283 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:54.678185 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7209820b-d9fe-4636-862c-8b8b4a486283 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:54.833576 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-7209820b-d9fe-4636-862c-8b8b4a486283 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:54.841751 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-7209820b-d9fe-4636-862c-8b8b4a486283 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.177967 May 16 17:40:54.842499 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 82/154] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:54 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:55.634527 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c3343ef5-3563-428e-a7c9-5ed3a67ee827 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:55.635072 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-c3343ef5-3563-428e-a7c9-5ed3a67ee827 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:55.642255 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c3343ef5-3563-428e-a7c9-5ed3a67ee827 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:55.642816 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c3343ef5-3563-428e-a7c9-5ed3a67ee827 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:55.643757 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c3343ef5-3563-428e-a7c9-5ed3a67ee827 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:55.644267 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c3343ef5-3563-428e-a7c9-5ed3a67ee827 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:55.796065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-c3343ef5-3563-428e-a7c9-5ed3a67ee827 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:55.805999 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-c3343ef5-3563-428e-a7c9-5ed3a67ee827 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.175295 May 16 17:40:55.816682 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 73/155] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:55 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:55.862998 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-431407d8-a06d-4e2f-acb4-a794e2b6a8dd tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:55.863694 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-431407d8-a06d-4e2f-acb4-a794e2b6a8dd tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:55.876737 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-431407d8-a06d-4e2f-acb4-a794e2b6a8dd tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:55.878115 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-431407d8-a06d-4e2f-acb4-a794e2b6a8dd tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:55.880036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-431407d8-a06d-4e2f-acb4-a794e2b6a8dd tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:55.881295 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-431407d8-a06d-4e2f-acb4-a794e2b6a8dd tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:56.038455 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-431407d8-a06d-4e2f-acb4-a794e2b6a8dd tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:56.046091 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-431407d8-a06d-4e2f-acb4-a794e2b6a8dd tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.189440 May 16 17:40:56.046660 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 83/156] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:55 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:56.350395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-3e86c564-f123-4d2e-bb25-bd7590568502 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:56.350919 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-3e86c564-f123-4d2e-bb25-bd7590568502 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:56.356796 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3e86c564-f123-4d2e-bb25-bd7590568502 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:56.357236 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3e86c564-f123-4d2e-bb25-bd7590568502 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:56.358042 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3e86c564-f123-4d2e-bb25-bd7590568502 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:56.358452 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3e86c564-f123-4d2e-bb25-bd7590568502 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:56.382804 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-3e86c564-f123-4d2e-bb25-bd7590568502 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Going to try to terminate instance {{(pid=128816) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:40:56.486306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-3e86c564-f123-4d2e-bb25-bd7590568502 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 204 len: 0 microversion: 2.1 time: 0.142395 May 16 17:40:56.487066 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 74/157] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:40:56 2022] DELETE /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:40:56.496156 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-96b31a2e-191b-4f54-8a93-0af553db366c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:56.497051 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-96b31a2e-191b-4f54-8a93-0af553db366c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:56.504819 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-96b31a2e-191b-4f54-8a93-0af553db366c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:56.505344 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-96b31a2e-191b-4f54-8a93-0af553db366c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:56.506272 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-96b31a2e-191b-4f54-8a93-0af553db366c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:56.506778 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-96b31a2e-191b-4f54-8a93-0af553db366c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:56.650296 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-96b31a2e-191b-4f54-8a93-0af553db366c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:56.659371 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-96b31a2e-191b-4f54-8a93-0af553db366c tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1552 microversion: 2.1 time: 0.167517 May 16 17:40:56.660048 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 84/158] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:56 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:56.823712 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4fe46a61-63c1-4629-9f8d-bb2ec8939305 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:56.824635 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4fe46a61-63c1-4629-9f8d-bb2ec8939305 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:56.831244 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4fe46a61-63c1-4629-9f8d-bb2ec8939305 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:56.831844 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4fe46a61-63c1-4629-9f8d-bb2ec8939305 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:56.832776 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4fe46a61-63c1-4629-9f8d-bb2ec8939305 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:56.833360 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4fe46a61-63c1-4629-9f8d-bb2ec8939305 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:56.965851 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-4fe46a61-63c1-4629-9f8d-bb2ec8939305 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:56.973320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4fe46a61-63c1-4629-9f8d-bb2ec8939305 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.153893 May 16 17:40:56.973913 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 75/159] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:56 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:57.062575 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5512284c-af1c-4b71-8685-d8edf630f3f7 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:57.063178 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-5512284c-af1c-4b71-8685-d8edf630f3f7 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:57.069535 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5512284c-af1c-4b71-8685-d8edf630f3f7 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:57.070011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5512284c-af1c-4b71-8685-d8edf630f3f7 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:57.070762 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5512284c-af1c-4b71-8685-d8edf630f3f7 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:57.071223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5512284c-af1c-4b71-8685-d8edf630f3f7 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:57.200806 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-5512284c-af1c-4b71-8685-d8edf630f3f7 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:57.208735 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-5512284c-af1c-4b71-8685-d8edf630f3f7 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.149773 May 16 17:40:57.209215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 85/160] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:57 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:57.390646 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-ff6a4660-e145-4346-aa1b-f8508592ad24 req-6057b1ee-d4af-4005-84e6-5b26e834bd38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa888899-08da-449a-bfec-44545e740ca8", "name": "network-vif-plugged", "status": "completed", "tag": "4008578d-3079-4492-b51b-6afa7663b028"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:40:57.399221 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-ff6a4660-e145-4346-aa1b-f8508592ad24 req-6057b1ee-d4af-4005-84e6-5b26e834bd38 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:57.399550 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-ff6a4660-e145-4346-aa1b-f8508592ad24 req-6057b1ee-d4af-4005-84e6-5b26e834bd38 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:57.410578 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-ff6a4660-e145-4346-aa1b-f8508592ad24 req-6057b1ee-d4af-4005-84e6-5b26e834bd38 service nova] Creating event network-vif-plugged:4008578d-3079-4492-b51b-6afa7663b028 for instance fa888899-08da-449a-bfec-44545e740ca8 on hv-cinder-83769 May 16 17:40:57.415595 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-ff6a4660-e145-4346-aa1b-f8508592ad24 req-6057b1ee-d4af-4005-84e6-5b26e834bd38 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028691 May 16 17:40:57.416189 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 76/161] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:40:57.677302 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-262d4ebb-0ec3-44ed-8b8b-4d5781b616da tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:57.677937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-262d4ebb-0ec3-44ed-8b8b-4d5781b616da tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:57.684516 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-262d4ebb-0ec3-44ed-8b8b-4d5781b616da tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:57.684967 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-262d4ebb-0ec3-44ed-8b8b-4d5781b616da tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:57.685776 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-262d4ebb-0ec3-44ed-8b8b-4d5781b616da tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:57.686207 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-262d4ebb-0ec3-44ed-8b8b-4d5781b616da tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:57.813588 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-262d4ebb-0ec3-44ed-8b8b-4d5781b616da tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:57.822227 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-262d4ebb-0ec3-44ed-8b8b-4d5781b616da tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1552 microversion: 2.1 time: 0.148881 May 16 17:40:57.822770 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 86/162] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:57 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:57.992812 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-87399549-7ad5-4a90-a35a-51c097e94b04 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:57.993514 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-87399549-7ad5-4a90-a35a-51c097e94b04 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:58.000395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-87399549-7ad5-4a90-a35a-51c097e94b04 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:58.000847 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-87399549-7ad5-4a90-a35a-51c097e94b04 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:58.001643 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-87399549-7ad5-4a90-a35a-51c097e94b04 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:58.002081 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-87399549-7ad5-4a90-a35a-51c097e94b04 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:58.143137 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-87399549-7ad5-4a90-a35a-51c097e94b04 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:58.150789 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-87399549-7ad5-4a90-a35a-51c097e94b04 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.162315 May 16 17:40:58.151361 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 77/163] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:57 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:58.226999 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-cf60f984-582e-4bcb-967f-5cd701729c68 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:58.227637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-cf60f984-582e-4bcb-967f-5cd701729c68 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:58.234402 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cf60f984-582e-4bcb-967f-5cd701729c68 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:58.234852 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cf60f984-582e-4bcb-967f-5cd701729c68 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:58.235609 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cf60f984-582e-4bcb-967f-5cd701729c68 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:58.236040 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cf60f984-582e-4bcb-967f-5cd701729c68 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:58.365078 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-cf60f984-582e-4bcb-967f-5cd701729c68 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:58.372778 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-cf60f984-582e-4bcb-967f-5cd701729c68 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.149751 May 16 17:40:58.373345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 87/164] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:58 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:58.843357 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4096dcc6-2e2e-483a-a0ff-08c838debdca tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:58.844406 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4096dcc6-2e2e-483a-a0ff-08c838debdca tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:58.854873 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4096dcc6-2e2e-483a-a0ff-08c838debdca tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:58.855619 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4096dcc6-2e2e-483a-a0ff-08c838debdca tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:58.856878 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4096dcc6-2e2e-483a-a0ff-08c838debdca tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:58.857632 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4096dcc6-2e2e-483a-a0ff-08c838debdca tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:58.994494 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-4096dcc6-2e2e-483a-a0ff-08c838debdca tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:59.002778 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4096dcc6-2e2e-483a-a0ff-08c838debdca tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1552 microversion: 2.1 time: 0.165864 May 16 17:40:59.003466 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 78/165] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:58 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:59.167557 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-720cbea9-a3fd-4387-a8e8-bf92fe417a52 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:59.168156 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-720cbea9-a3fd-4387-a8e8-bf92fe417a52 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:59.174414 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-720cbea9-a3fd-4387-a8e8-bf92fe417a52 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:59.174854 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-720cbea9-a3fd-4387-a8e8-bf92fe417a52 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:59.175635 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-720cbea9-a3fd-4387-a8e8-bf92fe417a52 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:59.176066 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-720cbea9-a3fd-4387-a8e8-bf92fe417a52 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:59.315213 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-720cbea9-a3fd-4387-a8e8-bf92fe417a52 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:59.322692 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-720cbea9-a3fd-4387-a8e8-bf92fe417a52 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.158969 May 16 17:40:59.325587 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 88/166] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:59 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:40:59.389710 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-8db328d7-732e-4d0f-b963-acb0abcea7ed tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:40:59.390338 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-8db328d7-732e-4d0f-b963-acb0abcea7ed tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:40:59.396370 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8db328d7-732e-4d0f-b963-acb0abcea7ed tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:59.396826 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8db328d7-732e-4d0f-b963-acb0abcea7ed tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:59.397609 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8db328d7-732e-4d0f-b963-acb0abcea7ed tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:40:59.398034 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8db328d7-732e-4d0f-b963-acb0abcea7ed tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:40:59.537758 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-8db328d7-732e-4d0f-b963-acb0abcea7ed tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:40:59.545605 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-8db328d7-732e-4d0f-b963-acb0abcea7ed tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.159454 May 16 17:40:59.546184 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 79/167] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:40:59 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:00.022788 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-55ce56b9-e715-44b8-bcb6-bca8bf6fc93e tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:00.023217 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-55ce56b9-e715-44b8-bcb6-bca8bf6fc93e tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:00.030469 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55ce56b9-e715-44b8-bcb6-bca8bf6fc93e tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:00.030920 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55ce56b9-e715-44b8-bcb6-bca8bf6fc93e tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:00.031698 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55ce56b9-e715-44b8-bcb6-bca8bf6fc93e tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:00.032136 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55ce56b9-e715-44b8-bcb6-bca8bf6fc93e tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:00.187166 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-55ce56b9-e715-44b8-bcb6-bca8bf6fc93e tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:00.196279 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-55ce56b9-e715-44b8-bcb6-bca8bf6fc93e tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1552 microversion: 2.1 time: 0.178316 May 16 17:41:00.196859 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 89/168] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:00 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1552 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:00.339276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-56a9e0d0-b0d3-49a4-92a8-4d6af72333bd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:00.339882 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-56a9e0d0-b0d3-49a4-92a8-4d6af72333bd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:00.345856 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-56a9e0d0-b0d3-49a4-92a8-4d6af72333bd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:00.346294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-56a9e0d0-b0d3-49a4-92a8-4d6af72333bd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:00.347079 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-56a9e0d0-b0d3-49a4-92a8-4d6af72333bd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:00.347499 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-56a9e0d0-b0d3-49a4-92a8-4d6af72333bd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:00.492480 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-56a9e0d0-b0d3-49a4-92a8-4d6af72333bd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:00.504005 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-56a9e0d0-b0d3-49a4-92a8-4d6af72333bd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.168539 May 16 17:41:00.504572 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 80/169] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:00 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:00.565048 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-55a48d8f-c54b-465d-a296-6fcf63bf2816 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:00.565660 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-55a48d8f-c54b-465d-a296-6fcf63bf2816 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:00.572676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55a48d8f-c54b-465d-a296-6fcf63bf2816 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:00.573130 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55a48d8f-c54b-465d-a296-6fcf63bf2816 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:00.573944 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55a48d8f-c54b-465d-a296-6fcf63bf2816 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:00.574378 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55a48d8f-c54b-465d-a296-6fcf63bf2816 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:00.713359 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-55a48d8f-c54b-465d-a296-6fcf63bf2816 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:00.721072 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-55a48d8f-c54b-465d-a296-6fcf63bf2816 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.162438 May 16 17:41:00.721671 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 90/170] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:00 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:01.217612 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c89325da-823a-4ca2-94bf-81588022a1fa tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:01.218627 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-c89325da-823a-4ca2-94bf-81588022a1fa tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:01.226564 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c89325da-823a-4ca2-94bf-81588022a1fa tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:01.227014 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c89325da-823a-4ca2-94bf-81588022a1fa tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:01.227783 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c89325da-823a-4ca2-94bf-81588022a1fa tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:01.228216 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c89325da-823a-4ca2-94bf-81588022a1fa tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:01.356086 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-c89325da-823a-4ca2-94bf-81588022a1fa tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:01.364116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-c89325da-823a-4ca2-94bf-81588022a1fa tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1552 microversion: 2.1 time: 0.152943 May 16 17:41:01.364692 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 81/171] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:01 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:01.521069 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-9706eb8d-2ce3-42b6-9c1e-fa917f987bfd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:01.521781 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-9706eb8d-2ce3-42b6-9c1e-fa917f987bfd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:01.527873 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9706eb8d-2ce3-42b6-9c1e-fa917f987bfd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:01.528383 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9706eb8d-2ce3-42b6-9c1e-fa917f987bfd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:01.529154 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9706eb8d-2ce3-42b6-9c1e-fa917f987bfd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:01.529595 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9706eb8d-2ce3-42b6-9c1e-fa917f987bfd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:01.664541 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-9706eb8d-2ce3-42b6-9c1e-fa917f987bfd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:01.672808 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-9706eb8d-2ce3-42b6-9c1e-fa917f987bfd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.156229 May 16 17:41:01.673319 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 91/172] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:01 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:01.738334 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-7b4a62be-0216-4685-bcc7-a233d8f8fa0f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:01.738936 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-7b4a62be-0216-4685-bcc7-a233d8f8fa0f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:01.745453 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7b4a62be-0216-4685-bcc7-a233d8f8fa0f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:01.745942 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7b4a62be-0216-4685-bcc7-a233d8f8fa0f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:01.746703 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7b4a62be-0216-4685-bcc7-a233d8f8fa0f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:01.747139 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7b4a62be-0216-4685-bcc7-a233d8f8fa0f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:01.882949 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-7b4a62be-0216-4685-bcc7-a233d8f8fa0f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:01.890575 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-7b4a62be-0216-4685-bcc7-a233d8f8fa0f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.156233 May 16 17:41:01.891151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 82/173] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:01 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:02.384811 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-40b757f1-13fa-48be-b116-c291a58e4d41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:02.385854 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-40b757f1-13fa-48be-b116-c291a58e4d41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:02.395463 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-40b757f1-13fa-48be-b116-c291a58e4d41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:02.395910 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-40b757f1-13fa-48be-b116-c291a58e4d41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:02.396671 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-40b757f1-13fa-48be-b116-c291a58e4d41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:02.397100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-40b757f1-13fa-48be-b116-c291a58e4d41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:02.536081 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-40b757f1-13fa-48be-b116-c291a58e4d41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:02.544254 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-40b757f1-13fa-48be-b116-c291a58e4d41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1552 microversion: 2.1 time: 0.165881 May 16 17:41:02.544824 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 92/174] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:02 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:02.689901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-5e7546f9-9ac9-44f2-a915-770509febb31 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:02.690486 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-5e7546f9-9ac9-44f2-a915-770509febb31 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:02.696998 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5e7546f9-9ac9-44f2-a915-770509febb31 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:02.697436 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5e7546f9-9ac9-44f2-a915-770509febb31 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:02.698240 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5e7546f9-9ac9-44f2-a915-770509febb31 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:02.698691 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5e7546f9-9ac9-44f2-a915-770509febb31 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:02.864082 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-5e7546f9-9ac9-44f2-a915-770509febb31 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:02.871845 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-5e7546f9-9ac9-44f2-a915-770509febb31 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.185941 May 16 17:41:02.872523 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 83/175] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:02 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:02.907884 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-bbe2dc3f-109c-4204-9195-9aa2333fdc57 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:02.908568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-bbe2dc3f-109c-4204-9195-9aa2333fdc57 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:02.915216 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bbe2dc3f-109c-4204-9195-9aa2333fdc57 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:02.915665 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bbe2dc3f-109c-4204-9195-9aa2333fdc57 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:02.916447 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bbe2dc3f-109c-4204-9195-9aa2333fdc57 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:02.916917 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bbe2dc3f-109c-4204-9195-9aa2333fdc57 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:03.086395 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-bbe2dc3f-109c-4204-9195-9aa2333fdc57 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:03.094474 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-bbe2dc3f-109c-4204-9195-9aa2333fdc57 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.190761 May 16 17:41:03.095046 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 93/176] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:02 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:03.566446 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b315c9cd-05df-4da0-aa92-d4173d3405c0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:03.566446 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b315c9cd-05df-4da0-aa92-d4173d3405c0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:03.572812 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b315c9cd-05df-4da0-aa92-d4173d3405c0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:03.573268 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b315c9cd-05df-4da0-aa92-d4173d3405c0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:03.574387 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b315c9cd-05df-4da0-aa92-d4173d3405c0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:03.575047 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b315c9cd-05df-4da0-aa92-d4173d3405c0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:03.778458 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-b315c9cd-05df-4da0-aa92-d4173d3405c0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:03.791694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b315c9cd-05df-4da0-aa92-d4173d3405c0 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1552 microversion: 2.1 time: 0.233287 May 16 17:41:03.792552 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 84/177] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:03 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1552 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:03.891414 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-7074993b-8db3-4fdc-9212-658d819aceff tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:03.892420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-7074993b-8db3-4fdc-9212-658d819aceff tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:03.899254 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7074993b-8db3-4fdc-9212-658d819aceff tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:03.899896 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7074993b-8db3-4fdc-9212-658d819aceff tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:03.900898 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7074993b-8db3-4fdc-9212-658d819aceff tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:03.904905 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7074993b-8db3-4fdc-9212-658d819aceff tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:04.111689 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-60618fdc-c882-4dab-90ce-29cc06ae2185 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:04.112303 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-60618fdc-c882-4dab-90ce-29cc06ae2185 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:04.123690 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-60618fdc-c882-4dab-90ce-29cc06ae2185 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:04.124361 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-60618fdc-c882-4dab-90ce-29cc06ae2185 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:04.125270 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-60618fdc-c882-4dab-90ce-29cc06ae2185 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:04.125865 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-60618fdc-c882-4dab-90ce-29cc06ae2185 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:04.300762 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-7074993b-8db3-4fdc-9212-658d819aceff tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:04.308328 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-7074993b-8db3-4fdc-9212-658d819aceff tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.421510 May 16 17:41:04.308908 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 94/178] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:03 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:41:04.328691 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-7f52d9f5-83a1-4b91-8c3b-405c011a0794 req-ff2afc67-8157-4e97-9c04-e685b57f5aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28e9f51-66b9-4218-a81f-08a168cbeb32", "name": "network-vif-deleted", "tag": "4df5132e-30e3-4c40-bd03-2d1fd0a87011"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:41:04.340462 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-7f52d9f5-83a1-4b91-8c3b-405c011a0794 req-ff2afc67-8157-4e97-9c04-e685b57f5aab service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:04.340908 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-7f52d9f5-83a1-4b91-8c3b-405c011a0794 req-ff2afc67-8157-4e97-9c04-e685b57f5aab service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:04.341576 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-60618fdc-c882-4dab-90ce-29cc06ae2185 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:04.350173 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-60618fdc-c882-4dab-90ce-29cc06ae2185 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1314 microversion: 2.1 time: 0.242376 May 16 17:41:04.351067 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 85/179] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:04 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:04.358474 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-7f52d9f5-83a1-4b91-8c3b-405c011a0794 req-ff2afc67-8157-4e97-9c04-e685b57f5aab service nova] Creating event network-vif-deleted:4df5132e-30e3-4c40-bd03-2d1fd0a87011 for instance a28e9f51-66b9-4218-a81f-08a168cbeb32 on hv-cinder-83769 May 16 17:41:04.365644 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-7f52d9f5-83a1-4b91-8c3b-405c011a0794 req-ff2afc67-8157-4e97-9c04-e685b57f5aab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042754 May 16 17:41:04.366270 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 95/180] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:41:04.809898 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-08f5eb6c-bd1c-4fe8-87a9-6fa31d480ae5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:04.810473 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-08f5eb6c-bd1c-4fe8-87a9-6fa31d480ae5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:04.816831 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-08f5eb6c-bd1c-4fe8-87a9-6fa31d480ae5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:04.817279 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-08f5eb6c-bd1c-4fe8-87a9-6fa31d480ae5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:04.818059 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-08f5eb6c-bd1c-4fe8-87a9-6fa31d480ae5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:04.818489 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-08f5eb6c-bd1c-4fe8-87a9-6fa31d480ae5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:04.887810 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-08f5eb6c-bd1c-4fe8-87a9-6fa31d480ae5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:04.895728 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-08f5eb6c-bd1c-4fe8-87a9-6fa31d480ae5 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1344 microversion: 2.1 time: 0.089768 May 16 17:41:04.896300 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 86/181] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:04 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:05.335988 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-67dcaf7f-bf6b-4271-a609-5cbd98486aed tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:05.337404 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-67dcaf7f-bf6b-4271-a609-5cbd98486aed tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:05.344344 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-67dcaf7f-bf6b-4271-a609-5cbd98486aed tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:05.345335 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-67dcaf7f-bf6b-4271-a609-5cbd98486aed tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:05.347169 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-67dcaf7f-bf6b-4271-a609-5cbd98486aed tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:05.347543 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-67dcaf7f-bf6b-4271-a609-5cbd98486aed tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:05.370247 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-78a22aeb-87e2-4cd4-aa8c-c4a4f94320b2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:05.371132 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-78a22aeb-87e2-4cd4-aa8c-c4a4f94320b2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:05.383282 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-78a22aeb-87e2-4cd4-aa8c-c4a4f94320b2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:05.383844 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-78a22aeb-87e2-4cd4-aa8c-c4a4f94320b2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:05.384740 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-78a22aeb-87e2-4cd4-aa8c-c4a4f94320b2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:05.385881 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-78a22aeb-87e2-4cd4-aa8c-c4a4f94320b2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:05.607946 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-78a22aeb-87e2-4cd4-aa8c-c4a4f94320b2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:05.616669 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-78a22aeb-87e2-4cd4-aa8c-c4a4f94320b2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1497 microversion: 2.1 time: 0.251003 May 16 17:41:05.622223 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 87/182] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:05 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1497 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:05.652438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-67dcaf7f-bf6b-4271-a609-5cbd98486aed tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:05.668802 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-67dcaf7f-bf6b-4271-a609-5cbd98486aed tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.333182 May 16 17:41:05.671805 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 96/183] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:05 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:05.913608 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e647ad10-1449-4912-b0f6-ddf0330f1c41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:05.914707 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e647ad10-1449-4912-b0f6-ddf0330f1c41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:05.921119 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e647ad10-1449-4912-b0f6-ddf0330f1c41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:05.921576 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e647ad10-1449-4912-b0f6-ddf0330f1c41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:05.922516 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e647ad10-1449-4912-b0f6-ddf0330f1c41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:05.923079 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e647ad10-1449-4912-b0f6-ddf0330f1c41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:05.955667 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e647ad10-1449-4912-b0f6-ddf0330f1c41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:05.956109 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e647ad10-1449-4912-b0f6-ddf0330f1c41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:05.956590 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-e647ad10-1449-4912-b0f6-ddf0330f1c41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lazy-loading 'fault' on Instance uuid a28e9f51-66b9-4218-a81f-08a168cbeb32 {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:41:06.006247 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e647ad10-1449-4912-b0f6-ddf0330f1c41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:06.014024 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e647ad10-1449-4912-b0f6-ddf0330f1c41 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1349 microversion: 2.1 time: 0.104244 May 16 17:41:06.014499 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 88/184] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:05 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1349 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:06.686416 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-72e3ec8c-a32e-47d2-9fa6-522617ef35df tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:06.687024 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-72e3ec8c-a32e-47d2-9fa6-522617ef35df tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:06.693747 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-72e3ec8c-a32e-47d2-9fa6-522617ef35df tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:06.694182 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-72e3ec8c-a32e-47d2-9fa6-522617ef35df tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:06.695233 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-72e3ec8c-a32e-47d2-9fa6-522617ef35df tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:06.695922 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-72e3ec8c-a32e-47d2-9fa6-522617ef35df tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:06.863885 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-72e3ec8c-a32e-47d2-9fa6-522617ef35df tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:06.871421 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-72e3ec8c-a32e-47d2-9fa6-522617ef35df tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.188960 May 16 17:41:06.871972 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 97/185] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:06 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:07.031572 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-cc77692f-a68b-446a-b01b-cb5d07a7b467 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:07.032183 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-cc77692f-a68b-446a-b01b-cb5d07a7b467 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:07.038037 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cc77692f-a68b-446a-b01b-cb5d07a7b467 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:07.038478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cc77692f-a68b-446a-b01b-cb5d07a7b467 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:07.039242 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cc77692f-a68b-446a-b01b-cb5d07a7b467 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:07.039669 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cc77692f-a68b-446a-b01b-cb5d07a7b467 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:07.071002 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cc77692f-a68b-446a-b01b-cb5d07a7b467 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:07.071448 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cc77692f-a68b-446a-b01b-cb5d07a7b467 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:07.071904 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-cc77692f-a68b-446a-b01b-cb5d07a7b467 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lazy-loading 'fault' on Instance uuid a28e9f51-66b9-4218-a81f-08a168cbeb32 {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:41:07.115767 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-cc77692f-a68b-446a-b01b-cb5d07a7b467 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:07.124935 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-cc77692f-a68b-446a-b01b-cb5d07a7b467 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1349 microversion: 2.1 time: 0.097198 May 16 17:41:07.125943 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 89/186] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:07 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:07.889186 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-09439fe6-b22c-4ec7-8c8c-d1cd1b82f828 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:07.889822 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-09439fe6-b22c-4ec7-8c8c-d1cd1b82f828 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:07.896051 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-09439fe6-b22c-4ec7-8c8c-d1cd1b82f828 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:07.896506 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-09439fe6-b22c-4ec7-8c8c-d1cd1b82f828 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:07.897398 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-09439fe6-b22c-4ec7-8c8c-d1cd1b82f828 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:07.897858 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-09439fe6-b22c-4ec7-8c8c-d1cd1b82f828 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:08.028317 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-09439fe6-b22c-4ec7-8c8c-d1cd1b82f828 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:08.036468 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-09439fe6-b22c-4ec7-8c8c-d1cd1b82f828 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.151338 May 16 17:41:08.037236 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 98/187] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:07 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:08.141977 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-932e94f5-970e-4b85-a10a-3a4d290c13c1 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:08.143144 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-932e94f5-970e-4b85-a10a-3a4d290c13c1 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:08.150017 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-932e94f5-970e-4b85-a10a-3a4d290c13c1 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:08.150687 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-932e94f5-970e-4b85-a10a-3a4d290c13c1 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:08.151454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-932e94f5-970e-4b85-a10a-3a4d290c13c1 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:08.151935 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-932e94f5-970e-4b85-a10a-3a4d290c13c1 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:08.182737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-932e94f5-970e-4b85-a10a-3a4d290c13c1 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:08.183426 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-932e94f5-970e-4b85-a10a-3a4d290c13c1 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:08.183861 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-932e94f5-970e-4b85-a10a-3a4d290c13c1 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lazy-loading 'fault' on Instance uuid a28e9f51-66b9-4218-a81f-08a168cbeb32 {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:41:08.427769 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-932e94f5-970e-4b85-a10a-3a4d290c13c1 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565fbf46701f48b383d24614caf7b576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954fb79bc14043c5a136989ab363e7fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:08.435952 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-932e94f5-970e-4b85-a10a-3a4d290c13c1 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 200 len: 1349 microversion: 2.1 time: 0.297878 May 16 17:41:08.436528 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 90/188] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:08 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 1349 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:08.952487 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-008d7505-fab4-4d08-97e4-64e483043f6c tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:08.953032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-008d7505-fab4-4d08-97e4-64e483043f6c tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:08.959671 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-008d7505-fab4-4d08-97e4-64e483043f6c tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:08.960214 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-008d7505-fab4-4d08-97e4-64e483043f6c tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:08.961036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-008d7505-fab4-4d08-97e4-64e483043f6c tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:08.961491 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-008d7505-fab4-4d08-97e4-64e483043f6c tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:08.986985 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-008d7505-fab4-4d08-97e4-64e483043f6c tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Going to try to terminate instance {{(pid=128815) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:41:09.056489 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-57fe8d66-541b-4831-b4e1-70fcbb706fbb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:09.057090 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-57fe8d66-541b-4831-b4e1-70fcbb706fbb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:09.063292 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-57fe8d66-541b-4831-b4e1-70fcbb706fbb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:09.063965 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-57fe8d66-541b-4831-b4e1-70fcbb706fbb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:09.064723 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-57fe8d66-541b-4831-b4e1-70fcbb706fbb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:09.065328 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-57fe8d66-541b-4831-b4e1-70fcbb706fbb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:09.073911 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-008d7505-fab4-4d08-97e4-64e483043f6c tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 204 len: 0 microversion: 2.1 time: 0.124922 May 16 17:41:09.074574 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 99/189] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:41:08 2022] DELETE /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:41:09.083587 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5c1c8eb2-aac1-461e-9652-e5981615403e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:09.084263 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-5c1c8eb2-aac1-461e-9652-e5981615403e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:09.090087 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5c1c8eb2-aac1-461e-9652-e5981615403e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:09.090611 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5c1c8eb2-aac1-461e-9652-e5981615403e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:09.091294 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5c1c8eb2-aac1-461e-9652-e5981615403e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:09.091721 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5c1c8eb2-aac1-461e-9652-e5981615403e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:09.252288 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-57fe8d66-541b-4831-b4e1-70fcbb706fbb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:09.260212 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-57fe8d66-541b-4831-b4e1-70fcbb706fbb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.207627 May 16 17:41:09.260764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 91/190] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:09 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:09.263014 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-5c1c8eb2-aac1-461e-9652-e5981615403e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:09.270917 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-5c1c8eb2-aac1-461e-9652-e5981615403e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1503 microversion: 2.1 time: 0.191494 May 16 17:41:09.271480 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 100/191] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:09 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1503 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:09.453771 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e6b284f6-2435-4358-a6ff-ad7dee4e153a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:09.454557 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e6b284f6-2435-4358-a6ff-ad7dee4e153a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:09.461524 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e6b284f6-2435-4358-a6ff-ad7dee4e153a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:09.462135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e6b284f6-2435-4358-a6ff-ad7dee4e153a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:09.463026 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e6b284f6-2435-4358-a6ff-ad7dee4e153a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:09.463500 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e6b284f6-2435-4358-a6ff-ad7dee4e153a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:09.479396 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-e6b284f6-2435-4358-a6ff-ad7dee4e153a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] HTTP exception thrown: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e6b284f6-2435-4358-a6ff-ad7dee4e153a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Request method failure captured: May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 HTTP/1.1 May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigoxsUfTMfvFx0O3cMvVGsQNNiNKUQv694Qe9Ru9pPr3Si2MgwA1Fsv9AStJs-8bTsYh1Aqo7Fb2WCzbRFPTrNQR6oaFjwlkic4dqKnCVC1QfC5rLPt5F5LYiTdjPdd442RuhQwW7xYYjbjyqBKJ6_ojnn5oLkgglzi4_PJPaou5u3hs May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 954fb79bc14043c5a136989ab363e7fd May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-DeleteServersTestJSON-613520639 May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:41:09.483995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:41:09.485325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/954fb79bc14043c5a136989ab363e7fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_954fb79bc14043c5a136989ab363e7fd", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/954fb79bc14043c5a136989ab363e7fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/954fb79bc14043c5a136989ab363e7fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:41:09.485325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-DeleteServersTestJSON-613520639 May 16 17:41:09.485325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 954fb79bc14043c5a136989ab363e7fd May 16 17:41:09.485325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-DeleteServersTestJSON-613520639 May 16 17:41:09.485325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-DeleteServersTestJSON-613520639-project May 16 17:41:09.485325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:41:09.485325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:41:09.485325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 565fbf46701f48b383d24614caf7b576 May 16 17:41:09.485325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-DeleteServersTestJSON-613520639-project May 16 17:41:09.485325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:41:09.485325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:09.485325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': 'a28e9f51-66b9-4218-a81f-08a168cbeb32'} May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:41:09.486368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:41:09.487877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:41:09.487877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:41:09.487877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:41:09.487877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:41:09.487877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:41:09.487877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:41:09.487877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:41:09.487877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:09.487877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:41:09.487877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:41:09.487877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:41:09.487877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:09.487877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:41:09.487877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:41:09.487877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:41:09.487877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:41:09.487877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:09.487877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:41:09.489395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e6b284f6-2435-4358-a6ff-ad7dee4e153a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Returning 404 to user: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:41:09.489395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e6b284f6-2435-4358-a6ff-ad7dee4e153a tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 404 len: 111 microversion: 2.1 time: 0.035910 May 16 17:41:09.489395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 92/192] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:09 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:41:09.592998 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-2874908b-a482-4e14-ad82-001b39d26893 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:09.594027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-2874908b-a482-4e14-ad82-001b39d26893 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:09.600769 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2874908b-a482-4e14-ad82-001b39d26893 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:09.601335 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2874908b-a482-4e14-ad82-001b39d26893 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:09.602237 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2874908b-a482-4e14-ad82-001b39d26893 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:09.602675 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2874908b-a482-4e14-ad82-001b39d26893 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:09.616198 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-2874908b-a482-4e14-ad82-001b39d26893 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] HTTP exception thrown: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-2874908b-a482-4e14-ad82-001b39d26893 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Request method failure captured: May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32/os-volume_attachments HTTP/1.1 May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigoxsUfTMfvFx0O3cMvVGsQNNiNKUQv694Qe9Ru9pPr3Si2MgwA1Fsv9AStJs-8bTsYh1Aqo7Fb2WCzbRFPTrNQR6oaFjwlkic4dqKnCVC1QfC5rLPt5F5LYiTdjPdd442RuhQwW7xYYjbjyqBKJ6_ojnn5oLkgglzi4_PJPaou5u3hs May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 954fb79bc14043c5a136989ab363e7fd May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-DeleteServersTestJSON-613520639 May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:41:09.620817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:41:09.622015 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/954fb79bc14043c5a136989ab363e7fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_954fb79bc14043c5a136989ab363e7fd", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/954fb79bc14043c5a136989ab363e7fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/954fb79bc14043c5a136989ab363e7fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:41:09.622015 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-DeleteServersTestJSON-613520639 May 16 17:41:09.622015 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 954fb79bc14043c5a136989ab363e7fd May 16 17:41:09.622015 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-DeleteServersTestJSON-613520639 May 16 17:41:09.622015 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-DeleteServersTestJSON-613520639-project May 16 17:41:09.622015 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:41:09.622015 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:41:09.622015 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: 565fbf46701f48b383d24614caf7b576 May 16 17:41:09.622015 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-DeleteServersTestJSON-613520639-project May 16 17:41:09.622015 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:41:09.622015 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:09.622015 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'server_id': 'a28e9f51-66b9-4218-a81f-08a168cbeb32'} May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:41:09.622652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:09.623695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:09.624960 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-2874908b-a482-4e14-ad82-001b39d26893 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Returning 404 to user: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:41:09.624960 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-2874908b-a482-4e14-ad82-001b39d26893 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033355 May 16 17:41:09.624960 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 101/193] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:41:09 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:41:10.280443 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-7437ceea-e13c-4a3e-bc03-f4007db3d63e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:10.281213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-7437ceea-e13c-4a3e-bc03-f4007db3d63e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:10.288368 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-c900623d-6cf2-4561-8cb9-611a989948ed tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:10.289106 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-c900623d-6cf2-4561-8cb9-611a989948ed tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:10.293152 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7437ceea-e13c-4a3e-bc03-f4007db3d63e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:10.293837 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7437ceea-e13c-4a3e-bc03-f4007db3d63e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:10.295194 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7437ceea-e13c-4a3e-bc03-f4007db3d63e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:10.295853 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7437ceea-e13c-4a3e-bc03-f4007db3d63e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:10.296444 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c900623d-6cf2-4561-8cb9-611a989948ed tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:10.297147 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c900623d-6cf2-4561-8cb9-611a989948ed tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:10.298142 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c900623d-6cf2-4561-8cb9-611a989948ed tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:10.298905 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c900623d-6cf2-4561-8cb9-611a989948ed tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:10.540094 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-7437ceea-e13c-4a3e-bc03-f4007db3d63e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:10.549037 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-7437ceea-e13c-4a3e-bc03-f4007db3d63e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.276654 May 16 17:41:10.549696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 93/194] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:10 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:10.554785 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-c900623d-6cf2-4561-8cb9-611a989948ed tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:10.564104 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-c900623d-6cf2-4561-8cb9-611a989948ed tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1503 microversion: 2.1 time: 0.279891 May 16 17:41:10.564886 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 102/195] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:10 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1503 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:10.932197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-553104ae-8f9d-434b-8fbc-eab6372b70aa tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:10.932694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-553104ae-8f9d-434b-8fbc-eab6372b70aa tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:10.939392 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-553104ae-8f9d-434b-8fbc-eab6372b70aa tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:10.939993 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-553104ae-8f9d-434b-8fbc-eab6372b70aa tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:10.947540 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-553104ae-8f9d-434b-8fbc-eab6372b70aa tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:10.947990 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-553104ae-8f9d-434b-8fbc-eab6372b70aa tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:10.970095 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-553104ae-8f9d-434b-8fbc-eab6372b70aa tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] HTTP exception thrown: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-553104ae-8f9d-434b-8fbc-eab6372b70aa tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Request method failure captured: May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: DELETE /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 HTTP/1.1 May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigoxsUfTMfvFx0O3cMvVGsQNNiNKUQv694Qe9Ru9pPr3Si2MgwA1Fsv9AStJs-8bTsYh1Aqo7Fb2WCzbRFPTrNQR6oaFjwlkic4dqKnCVC1QfC5rLPt5F5LYiTdjPdd442RuhQwW7xYYjbjyqBKJ6_ojnn5oLkgglzi4_PJPaou5u3hs May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 954fb79bc14043c5a136989ab363e7fd May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-DeleteServersTestJSON-613520639 May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:41:10.971621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:41:10.973106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/954fb79bc14043c5a136989ab363e7fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_954fb79bc14043c5a136989ab363e7fd", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/954fb79bc14043c5a136989ab363e7fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/954fb79bc14043c5a136989ab363e7fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:41:10.973106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-DeleteServersTestJSON-613520639 May 16 17:41:10.973106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 954fb79bc14043c5a136989ab363e7fd May 16 17:41:10.973106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-DeleteServersTestJSON-613520639 May 16 17:41:10.973106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-DeleteServersTestJSON-613520639-project May 16 17:41:10.973106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:41:10.973106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:41:10.973106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 565fbf46701f48b383d24614caf7b576 May 16 17:41:10.973106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-DeleteServersTestJSON-613520639-project May 16 17:41:10.973106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:41:10.973106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:10.973106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': 'a28e9f51-66b9-4218-a81f-08a168cbeb32'} May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:41:10.973923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:10.975197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:41:10.980574 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-553104ae-8f9d-434b-8fbc-eab6372b70aa tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Returning 404 to user: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:41:10.981600 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-553104ae-8f9d-434b-8fbc-eab6372b70aa tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 404 len: 111 microversion: 2.1 time: 0.053573 May 16 17:41:10.982553 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 94/196] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:41:10 2022] DELETE /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:41:10.990971 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5df863c6-4009-4a20-a127-8d3c0ebe5836 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:10.991592 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-5df863c6-4009-4a20-a127-8d3c0ebe5836 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] [instance: a28e9f51-66b9-4218-a81f-08a168cbeb32] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:10.997684 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5df863c6-4009-4a20-a127-8d3c0ebe5836 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:10.998134 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5df863c6-4009-4a20-a127-8d3c0ebe5836 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:10.998906 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5df863c6-4009-4a20-a127-8d3c0ebe5836 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:10.999338 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5df863c6-4009-4a20-a127-8d3c0ebe5836 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:11.021099 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-5df863c6-4009-4a20-a127-8d3c0ebe5836 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] HTTP exception thrown: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5df863c6-4009-4a20-a127-8d3c0ebe5836 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Request method failure captured: May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 HTTP/1.1 May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigoxsUfTMfvFx0O3cMvVGsQNNiNKUQv694Qe9Ru9pPr3Si2MgwA1Fsv9AStJs-8bTsYh1Aqo7Fb2WCzbRFPTrNQR6oaFjwlkic4dqKnCVC1QfC5rLPt5F5LYiTdjPdd442RuhQwW7xYYjbjyqBKJ6_ojnn5oLkgglzi4_PJPaou5u3hs May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 954fb79bc14043c5a136989ab363e7fd May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-DeleteServersTestJSON-613520639 May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:41:11.023828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:41:11.025304 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/954fb79bc14043c5a136989ab363e7fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_954fb79bc14043c5a136989ab363e7fd", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/954fb79bc14043c5a136989ab363e7fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/954fb79bc14043c5a136989ab363e7fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:41:11.025304 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-DeleteServersTestJSON-613520639 May 16 17:41:11.025304 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 954fb79bc14043c5a136989ab363e7fd May 16 17:41:11.025304 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-DeleteServersTestJSON-613520639 May 16 17:41:11.025304 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-DeleteServersTestJSON-613520639-project May 16 17:41:11.025304 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:41:11.025304 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:41:11.025304 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: 565fbf46701f48b383d24614caf7b576 May 16 17:41:11.025304 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-DeleteServersTestJSON-613520639-project May 16 17:41:11.025304 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:41:11.025304 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:11.025304 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': 'a28e9f51-66b9-4218-a81f-08a168cbeb32'} May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:41:11.026337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:41:11.027670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:41:11.027670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:41:11.027670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:41:11.027670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:41:11.027670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:41:11.027670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:41:11.027670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:41:11.027670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:11.027670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:11.027670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:41:11.027670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:11.027670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:11.027670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:41:11.027670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:41:11.027670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:41:11.027670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:41:11.027670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. May 16 17:41:11.027670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:11.030633 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5df863c6-4009-4a20-a127-8d3c0ebe5836 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] Returning 404 to user: Instance a28e9f51-66b9-4218-a81f-08a168cbeb32 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:41:11.030633 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-5df863c6-4009-4a20-a127-8d3c0ebe5836 tempest-DeleteServersTestJSON-613520639 tempest-DeleteServersTestJSON-613520639-project] 10.222.0.58 "GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32" status: 404 len: 111 microversion: 2.1 time: 0.040976 May 16 17:41:11.030633 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 103/197] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:10 2022] GET /compute/v2.1/servers/a28e9f51-66b9-4218-a81f-08a168cbeb32 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:41:11.569330 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-eaf3c268-f69a-402c-b743-69e8a055d4ad tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:11.571564 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-eaf3c268-f69a-402c-b743-69e8a055d4ad tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:11.582072 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-edf502f7-59a2-4012-b071-ae5f45be824f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:11.584016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-edf502f7-59a2-4012-b071-ae5f45be824f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:11.594147 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eaf3c268-f69a-402c-b743-69e8a055d4ad tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:11.595214 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-edf502f7-59a2-4012-b071-ae5f45be824f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:11.595837 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eaf3c268-f69a-402c-b743-69e8a055d4ad tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:11.596419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-edf502f7-59a2-4012-b071-ae5f45be824f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:11.600449 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eaf3c268-f69a-402c-b743-69e8a055d4ad tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:11.600890 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eaf3c268-f69a-402c-b743-69e8a055d4ad tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:11.602266 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-edf502f7-59a2-4012-b071-ae5f45be824f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:11.602987 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-edf502f7-59a2-4012-b071-ae5f45be824f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:11.726016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-edf502f7-59a2-4012-b071-ae5f45be824f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:11.734958 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-edf502f7-59a2-4012-b071-ae5f45be824f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1461 microversion: 2.1 time: 0.157454 May 16 17:41:11.736859 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 104/198] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:11 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1461 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:41:11.742271 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-759a90ec-262f-49b1-8477-5b9a96f2a790 req-32b00a73-c3a9-4a71-982f-06c0249348fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa888899-08da-449a-bfec-44545e740ca8", "name": "network-vif-deleted", "tag": "4008578d-3079-4492-b51b-6afa7663b028"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:41:11.752057 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-759a90ec-262f-49b1-8477-5b9a96f2a790 req-32b00a73-c3a9-4a71-982f-06c0249348fe service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:11.752489 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-759a90ec-262f-49b1-8477-5b9a96f2a790 req-32b00a73-c3a9-4a71-982f-06c0249348fe service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:11.764303 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-759a90ec-262f-49b1-8477-5b9a96f2a790 req-32b00a73-c3a9-4a71-982f-06c0249348fe service nova] Creating event network-vif-deleted:4008578d-3079-4492-b51b-6afa7663b028 for instance fa888899-08da-449a-bfec-44545e740ca8 on hv-cinder-83769 May 16 17:41:11.769583 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-759a90ec-262f-49b1-8477-5b9a96f2a790 req-32b00a73-c3a9-4a71-982f-06c0249348fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031149 May 16 17:41:11.770756 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 105/199] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:41:11.870547 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-eaf3c268-f69a-402c-b743-69e8a055d4ad tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:11.879216 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-eaf3c268-f69a-402c-b743-69e8a055d4ad tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.316329 May 16 17:41:11.891859 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 95/200] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:11 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:12.753424 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-df8f7898-70fd-405e-9af8-e34c306929ba tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:12.754929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-df8f7898-70fd-405e-9af8-e34c306929ba tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:12.763065 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-df8f7898-70fd-405e-9af8-e34c306929ba tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:12.763692 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-df8f7898-70fd-405e-9af8-e34c306929ba tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:12.764690 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-df8f7898-70fd-405e-9af8-e34c306929ba tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:12.765317 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-df8f7898-70fd-405e-9af8-e34c306929ba tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:12.800334 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-df8f7898-70fd-405e-9af8-e34c306929ba tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:12.800889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-df8f7898-70fd-405e-9af8-e34c306929ba tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:12.801424 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.objects.instance [None req-df8f7898-70fd-405e-9af8-e34c306929ba tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lazy-loading 'fault' on Instance uuid fa888899-08da-449a-bfec-44545e740ca8 {{(pid=128815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:41:12.856266 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-df8f7898-70fd-405e-9af8-e34c306929ba tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:12.871927 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-df8f7898-70fd-405e-9af8-e34c306929ba tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1304 microversion: 2.1 time: 0.122997 May 16 17:41:12.872780 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 106/201] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:12 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:12.898911 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ecd9e482-7126-4f2e-bcd1-e29de67a0bc6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:12.899509 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-ecd9e482-7126-4f2e-bcd1-e29de67a0bc6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:12.905944 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ecd9e482-7126-4f2e-bcd1-e29de67a0bc6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:12.906407 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ecd9e482-7126-4f2e-bcd1-e29de67a0bc6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:12.907164 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ecd9e482-7126-4f2e-bcd1-e29de67a0bc6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:12.907586 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ecd9e482-7126-4f2e-bcd1-e29de67a0bc6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:13.032396 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-ecd9e482-7126-4f2e-bcd1-e29de67a0bc6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:13.040341 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ecd9e482-7126-4f2e-bcd1-e29de67a0bc6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.145511 May 16 17:41:13.040988 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 96/202] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:12 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:13.888865 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-542b928f-cb71-470f-9693-7d7ce4f9b6c3 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:13.889403 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-542b928f-cb71-470f-9693-7d7ce4f9b6c3 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:13.896970 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-542b928f-cb71-470f-9693-7d7ce4f9b6c3 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:13.897418 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-542b928f-cb71-470f-9693-7d7ce4f9b6c3 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:13.898235 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-542b928f-cb71-470f-9693-7d7ce4f9b6c3 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:13.898694 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-542b928f-cb71-470f-9693-7d7ce4f9b6c3 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:13.932569 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-542b928f-cb71-470f-9693-7d7ce4f9b6c3 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:13.933018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-542b928f-cb71-470f-9693-7d7ce4f9b6c3 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:13.933472 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.objects.instance [None req-542b928f-cb71-470f-9693-7d7ce4f9b6c3 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lazy-loading 'fault' on Instance uuid fa888899-08da-449a-bfec-44545e740ca8 {{(pid=128815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:41:13.974894 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-542b928f-cb71-470f-9693-7d7ce4f9b6c3 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:13.982314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-542b928f-cb71-470f-9693-7d7ce4f9b6c3 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 200 len: 1304 microversion: 2.1 time: 0.097421 May 16 17:41:13.982864 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 107/203] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:13 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:14.057532 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ea9d8cc0-bef4-4ebc-9161-99e43aecd650 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:14.058160 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-ea9d8cc0-bef4-4ebc-9161-99e43aecd650 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:14.064187 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ea9d8cc0-bef4-4ebc-9161-99e43aecd650 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:14.064642 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ea9d8cc0-bef4-4ebc-9161-99e43aecd650 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:14.065488 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ea9d8cc0-bef4-4ebc-9161-99e43aecd650 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:14.066499 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ea9d8cc0-bef4-4ebc-9161-99e43aecd650 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:14.236477 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-ea9d8cc0-bef4-4ebc-9161-99e43aecd650 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:14.244022 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ea9d8cc0-bef4-4ebc-9161-99e43aecd650 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.190358 May 16 17:41:14.244593 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 97/204] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:14 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:15.000428 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-172c415c-e3da-4fb8-b7a4-5a2922675e8b tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:15.001268 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-172c415c-e3da-4fb8-b7a4-5a2922675e8b tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: fa888899-08da-449a-bfec-44545e740ca8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:15.010651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-172c415c-e3da-4fb8-b7a4-5a2922675e8b tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:15.011663 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-172c415c-e3da-4fb8-b7a4-5a2922675e8b tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:15.012534 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-172c415c-e3da-4fb8-b7a4-5a2922675e8b tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:15.013056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-172c415c-e3da-4fb8-b7a4-5a2922675e8b tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:15.029198 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-172c415c-e3da-4fb8-b7a4-5a2922675e8b tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] HTTP exception thrown: Instance fa888899-08da-449a-bfec-44545e740ca8 could not be found. May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-172c415c-e3da-4fb8-b7a4-5a2922675e8b tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Request method failure captured: May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 HTTP/1.1 May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigoyOojmssARpgDmOiNCtzsFBig4PCOpMKtKubk7LTVLt-EIB-UTrQOUKUSCZsatxOrUMpwWbp0gCpyXqjYjj-O7ci9VulS-1fEDn3BgbKOcWfxCHRO3xkL77EQItEKtyN1_hviMAqt6SnxQkTKZgn-xpuS3TYYLQcktd2io4HNCKq7M May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 39e8d3ee6d3e40dfbf0d32c7270a42fa May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-VolumesActionsTest-1928280374 May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:41:15.030961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:41:15.032158 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/39e8d3ee6d3e40dfbf0d32c7270a42fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_39e8d3ee6d3e40dfbf0d32c7270a42fa", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/39e8d3ee6d3e40dfbf0d32c7270a42fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/39e8d3ee6d3e40dfbf0d32c7270a42fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:41:15.032158 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-VolumesActionsTest-1928280374 May 16 17:41:15.032158 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 39e8d3ee6d3e40dfbf0d32c7270a42fa May 16 17:41:15.032158 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-VolumesActionsTest-1928280374 May 16 17:41:15.032158 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-VolumesActionsTest-1928280374-project May 16 17:41:15.032158 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:41:15.032158 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:41:15.032158 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: 4a557548cbc94c33a1d99d694d6b57c0 May 16 17:41:15.032158 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-VolumesActionsTest-1928280374-project May 16 17:41:15.032158 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:41:15.032158 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance fa888899-08da-449a-bfec-44545e740ca8 could not be found. May 16 17:41:15.032158 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': 'fa888899-08da-449a-bfec-44545e740ca8'} May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa888899-08da-449a-bfec-44545e740ca8 could not be found. May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:41:15.032951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:41:15.034223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:41:15.034223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:41:15.034223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:41:15.034223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:41:15.034223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:41:15.034223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:41:15.034223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:41:15.034223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa888899-08da-449a-bfec-44545e740ca8 could not be found. May 16 17:41:15.034223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:15.034223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:41:15.034223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:15.034223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:15.034223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:41:15.034223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:41:15.034223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:41:15.034223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:41:15.034223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa888899-08da-449a-bfec-44545e740ca8 could not be found. May 16 17:41:15.034223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:15.036202 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-172c415c-e3da-4fb8-b7a4-5a2922675e8b tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Returning 404 to user: Instance fa888899-08da-449a-bfec-44545e740ca8 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:41:15.037189 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-172c415c-e3da-4fb8-b7a4-5a2922675e8b tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8" status: 404 len: 111 microversion: 2.1 time: 0.042374 May 16 17:41:15.041603 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 108/205] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:14 2022] GET /compute/v2.1/servers/fa888899-08da-449a-bfec-44545e740ca8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:41:15.159938 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-97b8cd0e-4bc0-44de-a03e-efd78e9f8a72 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-719979466", "imageRef": "782bd628-ef1b-419c-99f5-2c312d1766a6", "flavorRef": "452", "networks": [{"uuid": "fd3dc598-e7d3-40a5-b9f8-1b772bc93fbb"}]}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:41:15.214312 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.network.neutron [None req-97b8cd0e-4bc0-44de-a03e-efd78e9f8a72 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] validate_networks() for [('fd3dc598-e7d3-40a5-b9f8-1b772bc93fbb', None, None, None, None, None)] {{(pid=128816) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:41:15.260685 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-b33cfc3d-37b1-4fd0-b7da-68046ba28a92 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:15.261302 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b33cfc3d-37b1-4fd0-b7da-68046ba28a92 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:15.267744 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b33cfc3d-37b1-4fd0-b7da-68046ba28a92 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:15.268192 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b33cfc3d-37b1-4fd0-b7da-68046ba28a92 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:15.269136 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b33cfc3d-37b1-4fd0-b7da-68046ba28a92 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:15.269585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b33cfc3d-37b1-4fd0-b7da-68046ba28a92 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:15.480947 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b33cfc3d-37b1-4fd0-b7da-68046ba28a92 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:15.490822 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-b33cfc3d-37b1-4fd0-b7da-68046ba28a92 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.233972 May 16 17:41:15.491882 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 109/206] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:15 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:41:15.662336 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-97b8cd0e-4bc0-44de-a03e-efd78e9f8a72 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Flavor limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:41:15.662726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-97b8cd0e-4bc0-44de-a03e-efd78e9f8a72 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Image limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:41:15.663207 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-97b8cd0e-4bc0-44de-a03e-efd78e9f8a72 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Flavor pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:41:15.663586 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-97b8cd0e-4bc0-44de-a03e-efd78e9f8a72 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Image pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:41:15.664124 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-97b8cd0e-4bc0-44de-a03e-efd78e9f8a72 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:41:15.673379 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-97b8cd0e-4bc0-44de-a03e-efd78e9f8a72 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:15.673870 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-97b8cd0e-4bc0-44de-a03e-efd78e9f8a72 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:15.674702 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-97b8cd0e-4bc0-44de-a03e-efd78e9f8a72 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:15.675127 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-97b8cd0e-4bc0-44de-a03e-efd78e9f8a72 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:15.700192 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-97b8cd0e-4bc0-44de-a03e-efd78e9f8a72 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Getting quotas for project 39e8d3ee6d3e40dfbf0d32c7270a42fa. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:41:15.704326 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-97b8cd0e-4bc0-44de-a03e-efd78e9f8a72 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Getting quotas for user 4a557548cbc94c33a1d99d694d6b57c0 and project 39e8d3ee6d3e40dfbf0d32c7270a42fa. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:41:15.717737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-97b8cd0e-4bc0-44de-a03e-efd78e9f8a72 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Going to run 1 instances... {{(pid=128816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:41:15.717839 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-97b8cd0e-4bc0-44de-a03e-efd78e9f8a72 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: 0e5aef79-c64c-45e3-904f-a2c26d3e97e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='782bd628-ef1b-419c-99f5-2c312d1766a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:41:15.770116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-97b8cd0e-4bc0-44de-a03e-efd78e9f8a72 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613883 May 16 17:41:15.770954 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 98/207] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:41:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:41:15.782067 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5504faf9-8152-4143-8f58-91f872bcfe48 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:15.782932 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-5504faf9-8152-4143-8f58-91f872bcfe48 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: 0e5aef79-c64c-45e3-904f-a2c26d3e97e8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:15.859726 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-5504faf9-8152-4143-8f58-91f872bcfe48 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:15.866569 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-5504faf9-8152-4143-8f58-91f872bcfe48 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8" status: 200 len: 1213 microversion: 2.1 time: 0.089288 May 16 17:41:15.870880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 110/208] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:15 2022] GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:16.508165 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-eb79cd94-8f63-4d11-bd13-3722f34bc732 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:16.508946 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-eb79cd94-8f63-4d11-bd13-3722f34bc732 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:16.516100 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eb79cd94-8f63-4d11-bd13-3722f34bc732 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:16.516790 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eb79cd94-8f63-4d11-bd13-3722f34bc732 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:16.517652 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eb79cd94-8f63-4d11-bd13-3722f34bc732 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:16.518284 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eb79cd94-8f63-4d11-bd13-3722f34bc732 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:16.671387 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-eb79cd94-8f63-4d11-bd13-3722f34bc732 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:16.679523 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-eb79cd94-8f63-4d11-bd13-3722f34bc732 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.175647 May 16 17:41:16.680110 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 99/209] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:16 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:16.886234 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f7596110-956f-4327-8270-6bea05bce1e2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:16.887589 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-f7596110-956f-4327-8270-6bea05bce1e2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: 0e5aef79-c64c-45e3-904f-a2c26d3e97e8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:16.894277 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f7596110-956f-4327-8270-6bea05bce1e2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:16.894731 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f7596110-956f-4327-8270-6bea05bce1e2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:16.895505 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f7596110-956f-4327-8270-6bea05bce1e2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:16.895931 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f7596110-956f-4327-8270-6bea05bce1e2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:17.005291 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-f7596110-956f-4327-8270-6bea05bce1e2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:17.020380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f7596110-956f-4327-8270-6bea05bce1e2 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8" status: 200 len: 1273 microversion: 2.1 time: 0.138131 May 16 17:41:17.021682 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 111/210] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:16 2022] GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8 => generated 1273 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:17.698639 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-7a486703-4a87-42d7-b641-4c53d9b5a3c8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:17.700430 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-7a486703-4a87-42d7-b641-4c53d9b5a3c8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:17.711848 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7a486703-4a87-42d7-b641-4c53d9b5a3c8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:17.716362 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7a486703-4a87-42d7-b641-4c53d9b5a3c8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:17.717853 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7a486703-4a87-42d7-b641-4c53d9b5a3c8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:17.718661 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7a486703-4a87-42d7-b641-4c53d9b5a3c8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:17.923532 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-7a486703-4a87-42d7-b641-4c53d9b5a3c8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:17.936600 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-7a486703-4a87-42d7-b641-4c53d9b5a3c8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.243891 May 16 17:41:17.947742 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 100/211] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:17 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:18.038400 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-1f836099-5b5e-4f50-87d1-ba7976c03c0f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:18.039054 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-1f836099-5b5e-4f50-87d1-ba7976c03c0f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: 0e5aef79-c64c-45e3-904f-a2c26d3e97e8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:18.049783 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1f836099-5b5e-4f50-87d1-ba7976c03c0f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:18.052297 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1f836099-5b5e-4f50-87d1-ba7976c03c0f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:18.053112 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1f836099-5b5e-4f50-87d1-ba7976c03c0f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:18.055771 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1f836099-5b5e-4f50-87d1-ba7976c03c0f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:18.248740 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-1f836099-5b5e-4f50-87d1-ba7976c03c0f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:18.258024 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-1f836099-5b5e-4f50-87d1-ba7976c03c0f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8" status: 200 len: 1313 microversion: 2.1 time: 0.223544 May 16 17:41:18.270429 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 112/212] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:18 2022] GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:18.954389 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-0f7861cc-7d54-4c37-9db8-851ac7c06feb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:18.955289 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-0f7861cc-7d54-4c37-9db8-851ac7c06feb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:18.962890 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0f7861cc-7d54-4c37-9db8-851ac7c06feb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:18.963330 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0f7861cc-7d54-4c37-9db8-851ac7c06feb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:18.964092 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0f7861cc-7d54-4c37-9db8-851ac7c06feb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:18.964514 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0f7861cc-7d54-4c37-9db8-851ac7c06feb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:18.984759 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-a06c1ad8-b7b4-4f42-be0c-a8d8eb56d722 req-1453417f-6674-43ff-89f5-cc0676d0e321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5aef79-c64c-45e3-904f-a2c26d3e97e8", "tag": "15f9d61c-a9f5-478e-ba2a-399956864e38"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:41:18.997469 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-a06c1ad8-b7b4-4f42-be0c-a8d8eb56d722 req-1453417f-6674-43ff-89f5-cc0676d0e321 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:18.998210 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-a06c1ad8-b7b4-4f42-be0c-a8d8eb56d722 req-1453417f-6674-43ff-89f5-cc0676d0e321 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:19.023252 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-a06c1ad8-b7b4-4f42-be0c-a8d8eb56d722 req-1453417f-6674-43ff-89f5-cc0676d0e321 service nova] Creating event network-changed:15f9d61c-a9f5-478e-ba2a-399956864e38 for instance 0e5aef79-c64c-45e3-904f-a2c26d3e97e8 on hv-cinder-83769 May 16 17:41:19.036641 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-a06c1ad8-b7b4-4f42-be0c-a8d8eb56d722 req-1453417f-6674-43ff-89f5-cc0676d0e321 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055991 May 16 17:41:19.037565 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 113/213] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:41:19.261756 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-0f7861cc-7d54-4c37-9db8-851ac7c06feb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:19.276700 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-61aef3bb-5da8-4c7d-8934-1c77b25b62d5 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:19.277407 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-61aef3bb-5da8-4c7d-8934-1c77b25b62d5 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: 0e5aef79-c64c-45e3-904f-a2c26d3e97e8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:19.278322 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-0f7861cc-7d54-4c37-9db8-851ac7c06feb tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.327697 May 16 17:41:19.285623 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-61aef3bb-5da8-4c7d-8934-1c77b25b62d5 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:19.286451 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-61aef3bb-5da8-4c7d-8934-1c77b25b62d5 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:19.287677 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-61aef3bb-5da8-4c7d-8934-1c77b25b62d5 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:19.288309 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-61aef3bb-5da8-4c7d-8934-1c77b25b62d5 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:19.290525 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 101/214] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:18 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:19.564778 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-61aef3bb-5da8-4c7d-8934-1c77b25b62d5 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:19.573724 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-61aef3bb-5da8-4c7d-8934-1c77b25b62d5 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8" status: 200 len: 1313 microversion: 2.1 time: 0.301802 May 16 17:41:19.577828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 114/215] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:19 2022] GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:41:20.296963 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-92315dc9-d60d-4e1a-bfee-e2d7950a4786 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:20.297717 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-92315dc9-d60d-4e1a-bfee-e2d7950a4786 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:20.305771 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-92315dc9-d60d-4e1a-bfee-e2d7950a4786 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:20.309044 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-92315dc9-d60d-4e1a-bfee-e2d7950a4786 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:20.310129 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-92315dc9-d60d-4e1a-bfee-e2d7950a4786 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:20.310557 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-92315dc9-d60d-4e1a-bfee-e2d7950a4786 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:20.481653 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-92315dc9-d60d-4e1a-bfee-e2d7950a4786 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:20.493174 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-92315dc9-d60d-4e1a-bfee-e2d7950a4786 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.200636 May 16 17:41:20.493963 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 102/216] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:20 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:20.598392 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-89f47850-1c42-4a94-b30d-59f9e2142a42 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:20.601755 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-89f47850-1c42-4a94-b30d-59f9e2142a42 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: 0e5aef79-c64c-45e3-904f-a2c26d3e97e8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:20.613267 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-89f47850-1c42-4a94-b30d-59f9e2142a42 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:20.614127 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-89f47850-1c42-4a94-b30d-59f9e2142a42 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:20.615515 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-89f47850-1c42-4a94-b30d-59f9e2142a42 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:20.616335 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-89f47850-1c42-4a94-b30d-59f9e2142a42 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:20.762061 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-89f47850-1c42-4a94-b30d-59f9e2142a42 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:20.769917 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-89f47850-1c42-4a94-b30d-59f9e2142a42 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8" status: 200 len: 1313 microversion: 2.1 time: 0.178532 May 16 17:41:20.777629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 115/217] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:20 2022] GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:21.510152 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-868821e9-ec93-459c-99ca-81c74ac58c03 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:21.510974 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-868821e9-ec93-459c-99ca-81c74ac58c03 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:21.520128 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-868821e9-ec93-459c-99ca-81c74ac58c03 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:21.521333 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-868821e9-ec93-459c-99ca-81c74ac58c03 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:21.525990 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-868821e9-ec93-459c-99ca-81c74ac58c03 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:21.526633 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-868821e9-ec93-459c-99ca-81c74ac58c03 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:21.741954 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-868821e9-ec93-459c-99ca-81c74ac58c03 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:21.752489 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-868821e9-ec93-459c-99ca-81c74ac58c03 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1521 microversion: 2.1 time: 0.246911 May 16 17:41:21.753466 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 103/218] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:21 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:21.786542 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d99ecbfa-a8cb-44da-92c1-d909e279973e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:21.788017 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d99ecbfa-a8cb-44da-92c1-d909e279973e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: 0e5aef79-c64c-45e3-904f-a2c26d3e97e8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:21.794582 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d99ecbfa-a8cb-44da-92c1-d909e279973e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:21.800893 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d99ecbfa-a8cb-44da-92c1-d909e279973e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:21.803104 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d99ecbfa-a8cb-44da-92c1-d909e279973e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:21.803553 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d99ecbfa-a8cb-44da-92c1-d909e279973e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:21.973440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d99ecbfa-a8cb-44da-92c1-d909e279973e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:21.981828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d99ecbfa-a8cb-44da-92c1-d909e279973e tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8" status: 200 len: 1313 microversion: 2.1 time: 0.199197 May 16 17:41:21.983001 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 116/219] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:21 2022] GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:22.772205 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-66e352df-35f8-4d99-a45d-b7ade89ee680 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:22.774159 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-66e352df-35f8-4d99-a45d-b7ade89ee680 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:22.782177 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-66e352df-35f8-4d99-a45d-b7ade89ee680 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:22.783186 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-66e352df-35f8-4d99-a45d-b7ade89ee680 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:22.784821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-66e352df-35f8-4d99-a45d-b7ade89ee680 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:22.785419 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-66e352df-35f8-4d99-a45d-b7ade89ee680 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:22.998580 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-884789b0-4a02-4af9-9037-d7d3c5b26211 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:22.999808 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-884789b0-4a02-4af9-9037-d7d3c5b26211 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: 0e5aef79-c64c-45e3-904f-a2c26d3e97e8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:23.007053 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-884789b0-4a02-4af9-9037-d7d3c5b26211 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:23.008581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-884789b0-4a02-4af9-9037-d7d3c5b26211 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:23.009541 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-884789b0-4a02-4af9-9037-d7d3c5b26211 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:23.010145 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-884789b0-4a02-4af9-9037-d7d3c5b26211 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:23.012829 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-66e352df-35f8-4d99-a45d-b7ade89ee680 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:23.022764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-66e352df-35f8-4d99-a45d-b7ade89ee680 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1501 microversion: 2.1 time: 0.257416 May 16 17:41:23.023838 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 104/220] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:22 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1501 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:23.049206 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d59a6944-91e8-4c82-ac85-527203ccad01 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:23.050165 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d59a6944-91e8-4c82-ac85-527203ccad01 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:23.056656 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d59a6944-91e8-4c82-ac85-527203ccad01 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:23.057396 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d59a6944-91e8-4c82-ac85-527203ccad01 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:23.058695 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d59a6944-91e8-4c82-ac85-527203ccad01 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:23.059554 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d59a6944-91e8-4c82-ac85-527203ccad01 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:23.383746 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-884789b0-4a02-4af9-9037-d7d3c5b26211 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:23.384317 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d59a6944-91e8-4c82-ac85-527203ccad01 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:23.392938 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-884789b0-4a02-4af9-9037-d7d3c5b26211 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8" status: 200 len: 1313 microversion: 2.1 time: 0.398120 May 16 17:41:23.394487 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 117/221] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:22 2022] GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:41:23.401960 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d59a6944-91e8-4c82-ac85-527203ccad01 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1515 microversion: 2.1 time: 0.351655 May 16 17:41:23.406138 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 105/222] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:23 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1515 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:23.841292 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-a3078762-105d-4bf5-af50-95dbf7cf6c0c req-b15e0260-a617-4efc-a3dd-50f9a9244a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5aef79-c64c-45e3-904f-a2c26d3e97e8", "name": "network-vif-plugged", "status": "completed", "tag": "15f9d61c-a9f5-478e-ba2a-399956864e38"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:41:23.851408 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-a3078762-105d-4bf5-af50-95dbf7cf6c0c req-b15e0260-a617-4efc-a3dd-50f9a9244a32 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:23.851844 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-a3078762-105d-4bf5-af50-95dbf7cf6c0c req-b15e0260-a617-4efc-a3dd-50f9a9244a32 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:23.865173 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-a3078762-105d-4bf5-af50-95dbf7cf6c0c req-b15e0260-a617-4efc-a3dd-50f9a9244a32 service nova] Creating event network-vif-plugged:15f9d61c-a9f5-478e-ba2a-399956864e38 for instance 0e5aef79-c64c-45e3-904f-a2c26d3e97e8 on hv-cinder-83769 May 16 17:41:23.873249 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-a3078762-105d-4bf5-af50-95dbf7cf6c0c req-b15e0260-a617-4efc-a3dd-50f9a9244a32 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035057 May 16 17:41:23.874679 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 118/223] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:41:24.412083 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c26f2191-6d59-457b-baf3-b137a6777c94 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:24.413345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-c26f2191-6d59-457b-baf3-b137a6777c94 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: 0e5aef79-c64c-45e3-904f-a2c26d3e97e8] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:24.435629 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c26f2191-6d59-457b-baf3-b137a6777c94 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:24.436334 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c26f2191-6d59-457b-baf3-b137a6777c94 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:24.439020 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c26f2191-6d59-457b-baf3-b137a6777c94 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:24.439508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c26f2191-6d59-457b-baf3-b137a6777c94 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:24.687593 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-c26f2191-6d59-457b-baf3-b137a6777c94 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:24.701017 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-c26f2191-6d59-457b-baf3-b137a6777c94 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8" status: 200 len: 1313 microversion: 2.1 time: 0.293046 May 16 17:41:24.702851 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 106/224] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:24 2022] GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:25.491520 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ba49efc6-76f1-4a22-9620-4e5467167fec tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:41:25.492559 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ba49efc6-76f1-4a22-9620-4e5467167fec tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:25.499657 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ba49efc6-76f1-4a22-9620-4e5467167fec tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:25.500319 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ba49efc6-76f1-4a22-9620-4e5467167fec tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:25.501251 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ba49efc6-76f1-4a22-9620-4e5467167fec tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:25.501847 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ba49efc6-76f1-4a22-9620-4e5467167fec tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:25.528097 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.objects.instance [None req-ba49efc6-76f1-4a22-9620-4e5467167fec tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lazy-loading 'flavor' on Instance uuid b033cd6f-aebe-48ae-aefd-f505e6f16bbc {{(pid=128815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:41:25.645475 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ba49efc6-76f1-4a22-9620-4e5467167fec tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "POST /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc/action" status: 200 len: 32 microversion: 2.1 time: 0.157770 May 16 17:41:25.647037 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 119/225] 10.222.0.58 () {60 vars in 1277 bytes} [Mon May 16 17:41:25 2022] POST /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 17:41:25.655875 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-22595f08-91e8-441e-b0d7-571fabafd983 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:25.656476 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-22595f08-91e8-441e-b0d7-571fabafd983 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:25.662890 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-22595f08-91e8-441e-b0d7-571fabafd983 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:25.663602 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-22595f08-91e8-441e-b0d7-571fabafd983 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:25.665124 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-22595f08-91e8-441e-b0d7-571fabafd983 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:25.665824 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-22595f08-91e8-441e-b0d7-571fabafd983 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:25.720321 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f6aa8024-1b7c-4f5a-a56d-e841244f38d9 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:25.722006 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-f6aa8024-1b7c-4f5a-a56d-e841244f38d9 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: 0e5aef79-c64c-45e3-904f-a2c26d3e97e8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:25.732728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f6aa8024-1b7c-4f5a-a56d-e841244f38d9 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:25.733192 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f6aa8024-1b7c-4f5a-a56d-e841244f38d9 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:25.734027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f6aa8024-1b7c-4f5a-a56d-e841244f38d9 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:25.734448 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f6aa8024-1b7c-4f5a-a56d-e841244f38d9 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:26.076361 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-22595f08-91e8-441e-b0d7-571fabafd983 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:26.088558 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-22595f08-91e8-441e-b0d7-571fabafd983 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.436253 May 16 17:41:26.091142 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 107/226] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:25 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:26.107532 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-f6aa8024-1b7c-4f5a-a56d-e841244f38d9 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:26.116076 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f6aa8024-1b7c-4f5a-a56d-e841244f38d9 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8" status: 200 len: 1313 microversion: 2.1 time: 0.400635 May 16 17:41:26.117378 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 120/227] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:25 2022] GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8 => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:27.107541 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-6c074f65-c21a-4117-9f15-48048b183297 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:27.108144 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-6c074f65-c21a-4117-9f15-48048b183297 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:27.116913 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6c074f65-c21a-4117-9f15-48048b183297 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:27.116913 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6c074f65-c21a-4117-9f15-48048b183297 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:27.135500 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-3cb4a1b1-aecf-404f-bfd0-6e1b75bea46f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:27.137354 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-3cb4a1b1-aecf-404f-bfd0-6e1b75bea46f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: 0e5aef79-c64c-45e3-904f-a2c26d3e97e8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:27.137723 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6c074f65-c21a-4117-9f15-48048b183297 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:27.138290 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6c074f65-c21a-4117-9f15-48048b183297 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:27.147722 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3cb4a1b1-aecf-404f-bfd0-6e1b75bea46f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:27.149204 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3cb4a1b1-aecf-404f-bfd0-6e1b75bea46f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:27.150677 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3cb4a1b1-aecf-404f-bfd0-6e1b75bea46f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:27.151300 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3cb4a1b1-aecf-404f-bfd0-6e1b75bea46f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:27.464722 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-6c074f65-c21a-4117-9f15-48048b183297 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:27.472578 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-6c074f65-c21a-4117-9f15-48048b183297 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.368733 May 16 17:41:27.472991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 108/228] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:27 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:27.574169 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3cb4a1b1-aecf-404f-bfd0-6e1b75bea46f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:27.584295 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-3cb4a1b1-aecf-404f-bfd0-6e1b75bea46f tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8" status: 200 len: 1497 microversion: 2.1 time: 0.453681 May 16 17:41:27.585500 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 121/229] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:27 2022] GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8 => generated 1497 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:41:28.489080 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-269132fe-ddea-4ab4-8311-90df04026cb6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:28.489853 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-269132fe-ddea-4ab4-8311-90df04026cb6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:28.496168 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-269132fe-ddea-4ab4-8311-90df04026cb6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:28.496622 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-269132fe-ddea-4ab4-8311-90df04026cb6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:28.497398 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-269132fe-ddea-4ab4-8311-90df04026cb6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:28.497884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-269132fe-ddea-4ab4-8311-90df04026cb6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:28.654241 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-269132fe-ddea-4ab4-8311-90df04026cb6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:28.663976 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-269132fe-ddea-4ab4-8311-90df04026cb6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.179028 May 16 17:41:28.665659 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 109/230] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:28 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:29.216105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-888c1a4b-04a9-49d5-9ef7-50abbc87b91b tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:29.216697 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-888c1a4b-04a9-49d5-9ef7-50abbc87b91b tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: 0e5aef79-c64c-45e3-904f-a2c26d3e97e8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:29.242098 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-888c1a4b-04a9-49d5-9ef7-50abbc87b91b tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:29.243895 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-888c1a4b-04a9-49d5-9ef7-50abbc87b91b tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:29.244968 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-888c1a4b-04a9-49d5-9ef7-50abbc87b91b tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:29.245837 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-888c1a4b-04a9-49d5-9ef7-50abbc87b91b tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:29.309211 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-888c1a4b-04a9-49d5-9ef7-50abbc87b91b tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: 0e5aef79-c64c-45e3-904f-a2c26d3e97e8] Going to try to terminate instance {{(pid=128815) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:41:29.422032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-888c1a4b-04a9-49d5-9ef7-50abbc87b91b tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8" status: 204 len: 0 microversion: 2.1 time: 0.211019 May 16 17:41:29.423179 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 122/231] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:41:29 2022] DELETE /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:41:29.431214 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-7ebddad1-144c-4079-9b32-5058f31001f7 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:29.431824 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-7ebddad1-144c-4079-9b32-5058f31001f7 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: 0e5aef79-c64c-45e3-904f-a2c26d3e97e8] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:29.440372 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7ebddad1-144c-4079-9b32-5058f31001f7 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:29.440828 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7ebddad1-144c-4079-9b32-5058f31001f7 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:29.442118 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7ebddad1-144c-4079-9b32-5058f31001f7 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:29.442562 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7ebddad1-144c-4079-9b32-5058f31001f7 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:29.685410 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0a330a9f-7a9b-4e50-8f60-c42ac08cb1d0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:29.685410 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-0a330a9f-7a9b-4e50-8f60-c42ac08cb1d0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:29.700223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0a330a9f-7a9b-4e50-8f60-c42ac08cb1d0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:29.700681 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0a330a9f-7a9b-4e50-8f60-c42ac08cb1d0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:29.701467 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0a330a9f-7a9b-4e50-8f60-c42ac08cb1d0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:29.701931 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0a330a9f-7a9b-4e50-8f60-c42ac08cb1d0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:29.820381 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-7ebddad1-144c-4079-9b32-5058f31001f7 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:29.827902 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-7ebddad1-144c-4079-9b32-5058f31001f7 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8" status: 200 len: 1503 microversion: 2.1 time: 0.400502 May 16 17:41:29.830795 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 110/232] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:29 2022] GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8 => generated 1503 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:29.973438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-0a330a9f-7a9b-4e50-8f60-c42ac08cb1d0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:29.984076 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-0a330a9f-7a9b-4e50-8f60-c42ac08cb1d0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.304784 May 16 17:41:29.984879 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 123/233] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:29 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:41:30.847991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-7dfaf7ef-a55d-4938-a5ed-15b67c96f341 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:30.848817 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-7dfaf7ef-a55d-4938-a5ed-15b67c96f341 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: 0e5aef79-c64c-45e3-904f-a2c26d3e97e8] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:30.859656 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7dfaf7ef-a55d-4938-a5ed-15b67c96f341 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:30.862325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7dfaf7ef-a55d-4938-a5ed-15b67c96f341 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:30.863362 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7dfaf7ef-a55d-4938-a5ed-15b67c96f341 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:30.864024 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7dfaf7ef-a55d-4938-a5ed-15b67c96f341 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:31.003762 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-2fa1e83b-0131-43e8-a3e2-ed8a66f84597 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:31.005107 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-2fa1e83b-0131-43e8-a3e2-ed8a66f84597 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:31.015654 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2fa1e83b-0131-43e8-a3e2-ed8a66f84597 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:31.018795 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2fa1e83b-0131-43e8-a3e2-ed8a66f84597 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:31.021872 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2fa1e83b-0131-43e8-a3e2-ed8a66f84597 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:31.024361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2fa1e83b-0131-43e8-a3e2-ed8a66f84597 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:31.244340 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-7dfaf7ef-a55d-4938-a5ed-15b67c96f341 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:31.258542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-7dfaf7ef-a55d-4938-a5ed-15b67c96f341 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8" status: 200 len: 1503 microversion: 2.1 time: 0.414508 May 16 17:41:31.261667 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 111/234] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:30 2022] GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8 => generated 1503 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:31.352560 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-2fa1e83b-0131-43e8-a3e2-ed8a66f84597 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:31.371157 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-2fa1e83b-0131-43e8-a3e2-ed8a66f84597 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.373743 May 16 17:41:31.372600 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 124/235] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:30 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:32.281296 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-1ec606cb-87ef-4192-be1f-3fb2d1af11d0 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:32.282521 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-1ec606cb-87ef-4192-be1f-3fb2d1af11d0 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: 0e5aef79-c64c-45e3-904f-a2c26d3e97e8] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:32.291881 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1ec606cb-87ef-4192-be1f-3fb2d1af11d0 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:32.292404 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1ec606cb-87ef-4192-be1f-3fb2d1af11d0 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:32.293431 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1ec606cb-87ef-4192-be1f-3fb2d1af11d0 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:32.294146 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1ec606cb-87ef-4192-be1f-3fb2d1af11d0 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:32.389330 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d63bdec1-dfb8-4980-9d32-e45c2442055b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:32.391055 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d63bdec1-dfb8-4980-9d32-e45c2442055b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:32.398910 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d63bdec1-dfb8-4980-9d32-e45c2442055b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:32.399638 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d63bdec1-dfb8-4980-9d32-e45c2442055b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:32.400718 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d63bdec1-dfb8-4980-9d32-e45c2442055b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:32.401486 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d63bdec1-dfb8-4980-9d32-e45c2442055b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:32.523545 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-1ec606cb-87ef-4192-be1f-3fb2d1af11d0 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:32.532909 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-1ec606cb-87ef-4192-be1f-3fb2d1af11d0 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8" status: 200 len: 1503 microversion: 2.1 time: 0.255565 May 16 17:41:32.544466 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 112/236] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:32 2022] GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8 => generated 1503 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:32.630166 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d63bdec1-dfb8-4980-9d32-e45c2442055b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:32.638115 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d63bdec1-dfb8-4980-9d32-e45c2442055b tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.253275 May 16 17:41:32.639507 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 125/237] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:32 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:41:33.524443 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-a45d4fb0-4c02-491f-9894-d938a2fa0dd2 req-7b61d43c-5559-4898-b91c-d06bdaddf5fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5aef79-c64c-45e3-904f-a2c26d3e97e8", "name": "network-vif-deleted", "tag": "15f9d61c-a9f5-478e-ba2a-399956864e38"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:41:33.554856 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-211c4c9d-99c6-4f8c-8f25-d96c6206872a tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:33.555405 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-a45d4fb0-4c02-491f-9894-d938a2fa0dd2 req-7b61d43c-5559-4898-b91c-d06bdaddf5fb service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:33.555580 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-211c4c9d-99c6-4f8c-8f25-d96c6206872a tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: 0e5aef79-c64c-45e3-904f-a2c26d3e97e8] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:33.560780 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-a45d4fb0-4c02-491f-9894-d938a2fa0dd2 req-7b61d43c-5559-4898-b91c-d06bdaddf5fb service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:33.567192 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-211c4c9d-99c6-4f8c-8f25-d96c6206872a tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:33.567634 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-211c4c9d-99c6-4f8c-8f25-d96c6206872a tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:33.568408 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-211c4c9d-99c6-4f8c-8f25-d96c6206872a tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:33.577625 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-211c4c9d-99c6-4f8c-8f25-d96c6206872a tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:33.608008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-a45d4fb0-4c02-491f-9894-d938a2fa0dd2 req-7b61d43c-5559-4898-b91c-d06bdaddf5fb service nova] Creating event network-vif-deleted:15f9d61c-a9f5-478e-ba2a-399956864e38 for instance 0e5aef79-c64c-45e3-904f-a2c26d3e97e8 on hv-cinder-83769 May 16 17:41:33.632059 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-a45d4fb0-4c02-491f-9894-d938a2fa0dd2 req-7b61d43c-5559-4898-b91c-d06bdaddf5fb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120730 May 16 17:41:33.635012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 113/238] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:41:33.657311 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-fc63cdd5-7905-4cf8-9745-add57df0b1ec tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:33.659311 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-fc63cdd5-7905-4cf8-9745-add57df0b1ec tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:33.682043 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fc63cdd5-7905-4cf8-9745-add57df0b1ec tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:33.686231 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fc63cdd5-7905-4cf8-9745-add57df0b1ec tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:33.692040 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fc63cdd5-7905-4cf8-9745-add57df0b1ec tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:33.696526 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fc63cdd5-7905-4cf8-9745-add57df0b1ec tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:33.810480 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-211c4c9d-99c6-4f8c-8f25-d96c6206872a tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a557548cbc94c33a1d99d694d6b57c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8d3ee6d3e40dfbf0d32c7270a42fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:33.818912 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-211c4c9d-99c6-4f8c-8f25-d96c6206872a tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8" status: 200 len: 1298 microversion: 2.1 time: 0.272923 May 16 17:41:33.823119 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 126/239] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:33 2022] GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8 => generated 1298 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:34.081533 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-fc63cdd5-7905-4cf8-9745-add57df0b1ec tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:34.093322 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-fc63cdd5-7905-4cf8-9745-add57df0b1ec tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.437715 May 16 17:41:34.099895 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 114/240] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:33 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:41:34.300230 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-76ce4fd6-c310-4f76-9dc7-eb199c0ecaf4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:34.301024 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-76ce4fd6-c310-4f76-9dc7-eb199c0ecaf4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:34.309720 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-76ce4fd6-c310-4f76-9dc7-eb199c0ecaf4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:34.310182 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-76ce4fd6-c310-4f76-9dc7-eb199c0ecaf4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:34.311425 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-76ce4fd6-c310-4f76-9dc7-eb199c0ecaf4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:34.311868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-76ce4fd6-c310-4f76-9dc7-eb199c0ecaf4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:34.346521 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-76ce4fd6-c310-4f76-9dc7-eb199c0ecaf4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/ips" status: 200 len: 150 microversion: 2.1 time: 0.050311 May 16 17:41:34.347126 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 127/241] 10.222.0.58 () {58 vars in 1247 bytes} [Mon May 16 17:41:34 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:41:34.846212 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-99ec9d3e-39ae-4f73-ba5d-c32463dca0e6 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:34.846942 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-99ec9d3e-39ae-4f73-ba5d-c32463dca0e6 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] [instance: 0e5aef79-c64c-45e3-904f-a2c26d3e97e8] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:34.857480 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-99ec9d3e-39ae-4f73-ba5d-c32463dca0e6 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:34.858417 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-99ec9d3e-39ae-4f73-ba5d-c32463dca0e6 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:34.860967 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-99ec9d3e-39ae-4f73-ba5d-c32463dca0e6 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:34.864656 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-99ec9d3e-39ae-4f73-ba5d-c32463dca0e6 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:34.896686 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-99ec9d3e-39ae-4f73-ba5d-c32463dca0e6 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] HTTP exception thrown: Instance 0e5aef79-c64c-45e3-904f-a2c26d3e97e8 could not be found. May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-99ec9d3e-39ae-4f73-ba5d-c32463dca0e6 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Request method failure captured: May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8 HTTP/1.1 May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigoyOojmssARpgDmOiNCtzsFBig4PCOpMKtKubk7LTVLt-EIB-UTrQOUKUSCZsatxOrUMpwWbp0gCpyXqjYjj-O7ci9VulS-1fEDn3BgbKOcWfxCHRO3xkL77EQItEKtyN1_hviMAqt6SnxQkTKZgn-xpuS3TYYLQcktd2io4HNCKq7M May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 39e8d3ee6d3e40dfbf0d32c7270a42fa May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-VolumesActionsTest-1928280374 May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:41:34.898680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:41:34.900222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/39e8d3ee6d3e40dfbf0d32c7270a42fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_39e8d3ee6d3e40dfbf0d32c7270a42fa", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/39e8d3ee6d3e40dfbf0d32c7270a42fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/39e8d3ee6d3e40dfbf0d32c7270a42fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:41:34.900222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-VolumesActionsTest-1928280374 May 16 17:41:34.900222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 39e8d3ee6d3e40dfbf0d32c7270a42fa May 16 17:41:34.900222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-VolumesActionsTest-1928280374 May 16 17:41:34.900222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-VolumesActionsTest-1928280374-project May 16 17:41:34.900222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:41:34.900222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:41:34.900222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 4a557548cbc94c33a1d99d694d6b57c0 May 16 17:41:34.900222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-VolumesActionsTest-1928280374-project May 16 17:41:34.900222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:41:34.900222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance 0e5aef79-c64c-45e3-904f-a2c26d3e97e8 could not be found. May 16 17:41:34.900222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': '0e5aef79-c64c-45e3-904f-a2c26d3e97e8'} May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e5aef79-c64c-45e3-904f-a2c26d3e97e8 could not be found. May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:41:34.901021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:41:34.902666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:41:34.902666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:41:34.902666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:41:34.902666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:41:34.902666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:41:34.902666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:41:34.902666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:41:34.902666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e5aef79-c64c-45e3-904f-a2c26d3e97e8 could not be found. May 16 17:41:34.902666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:41:34.902666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:41:34.902666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:41:34.902666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:34.902666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:41:34.902666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:41:34.902666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:41:34.902666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:41:34.902666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e5aef79-c64c-45e3-904f-a2c26d3e97e8 could not be found. May 16 17:41:34.902666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:41:34.909929 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-99ec9d3e-39ae-4f73-ba5d-c32463dca0e6 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] Returning 404 to user: Instance 0e5aef79-c64c-45e3-904f-a2c26d3e97e8 could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:41:34.911738 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-99ec9d3e-39ae-4f73-ba5d-c32463dca0e6 tempest-VolumesActionsTest-1928280374 tempest-VolumesActionsTest-1928280374-project] 10.222.0.58 "GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8" status: 404 len: 111 microversion: 2.1 time: 0.075487 May 16 17:41:34.924490 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 115/242] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:34 2022] GET /compute/v2.1/servers/0e5aef79-c64c-45e3-904f-a2c26d3e97e8 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:41:35.117127 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e4d3d2c0-44d7-447c-81d3-d2bb0b2b454a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:35.118479 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-e4d3d2c0-44d7-447c-81d3-d2bb0b2b454a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:35.128775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e4d3d2c0-44d7-447c-81d3-d2bb0b2b454a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:35.131869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e4d3d2c0-44d7-447c-81d3-d2bb0b2b454a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:35.140177 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e4d3d2c0-44d7-447c-81d3-d2bb0b2b454a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:35.140829 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e4d3d2c0-44d7-447c-81d3-d2bb0b2b454a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:35.488768 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-e4d3d2c0-44d7-447c-81d3-d2bb0b2b454a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:35.498455 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-e4d3d2c0-44d7-447c-81d3-d2bb0b2b454a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.385976 May 16 17:41:35.499037 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 128/243] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:35 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:36.449853 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-bcdd0ec5-6f14-4d4d-96b7-59d7eaa3488a tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Action: 'create', calling method: .version_select at 0x7f79a4acee50>, body: {"keypair": {"name": "tempest-TestShelveInstance-471635196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIA3ZamGoTHMdv67+10Lh3e/OcE1/onK52Tb+t9aj2N3HMbdiELJHiQIle+cQ2jWfZo/FYJNjk1pGCmOINEwagBIBeTd078gDMOqaqaRxmkO5aix8KdDH1TrHfEEOzHPg=="}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:41:36.464609 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-bcdd0ec5-6f14-4d4d-96b7-59d7eaa3488a tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Getting quotas for project 7ee0e621e3c34c3bba8434228c575a84. Resources: {'key_pairs'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:41:36.468832 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-bcdd0ec5-6f14-4d4d-96b7-59d7eaa3488a tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Getting quotas for user 1ae731332a684481bef208fe5bfc4866 and project 7ee0e621e3c34c3bba8434228c575a84. Resources: {'key_pairs'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:41:36.492331 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-bcdd0ec5-6f14-4d4d-96b7-59d7eaa3488a tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.219024 May 16 17:41:36.492929 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 116/244] 10.222.0.58 () {60 vars in 1158 bytes} [Mon May 16 17:41:36 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:41:36.515426 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-6acfa28f-a67a-40bd-a5e5-e1168131e775 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:36.516063 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-6acfa28f-a67a-40bd-a5e5-e1168131e775 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:36.522796 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6acfa28f-a67a-40bd-a5e5-e1168131e775 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:36.523284 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6acfa28f-a67a-40bd-a5e5-e1168131e775 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:36.524220 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6acfa28f-a67a-40bd-a5e5-e1168131e775 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:36.524752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6acfa28f-a67a-40bd-a5e5-e1168131e775 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:36.708109 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-6acfa28f-a67a-40bd-a5e5-e1168131e775 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:36.716086 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-6acfa28f-a67a-40bd-a5e5-e1168131e775 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.204446 May 16 17:41:36.717076 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 129/245] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:36 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:37.736219 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-52d7e303-aaff-464a-a528-eb0417e20165 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:37.737937 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-52d7e303-aaff-464a-a528-eb0417e20165 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:37.746162 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-52d7e303-aaff-464a-a528-eb0417e20165 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:37.749094 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-52d7e303-aaff-464a-a528-eb0417e20165 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:37.749924 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-52d7e303-aaff-464a-a528-eb0417e20165 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:37.750533 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-52d7e303-aaff-464a-a528-eb0417e20165 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:37.941177 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-52d7e303-aaff-464a-a528-eb0417e20165 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:37.949075 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-52d7e303-aaff-464a-a528-eb0417e20165 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.217409 May 16 17:41:37.950127 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 117/246] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:37 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:38.008405 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-821c1e7c-e51a-44b1-8b00-f5a426327c8c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7eaa2d30-bc5a-41d4-81d3-ce9536e713cb"}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:41:38.009674 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-821c1e7c-e51a-44b1-8b00-f5a426327c8c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:38.016390 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-821c1e7c-e51a-44b1-8b00-f5a426327c8c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:38.016922 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-821c1e7c-e51a-44b1-8b00-f5a426327c8c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:38.017901 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-821c1e7c-e51a-44b1-8b00-f5a426327c8c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:38.018431 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-821c1e7c-e51a-44b1-8b00-f5a426327c8c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:38.966609 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4bcdd282-122a-414e-b8b9-50b153c8704a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:38.967756 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4bcdd282-122a-414e-b8b9-50b153c8704a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:38.975445 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4bcdd282-122a-414e-b8b9-50b153c8704a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:38.975884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4bcdd282-122a-414e-b8b9-50b153c8704a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:38.976842 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4bcdd282-122a-414e-b8b9-50b153c8704a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:38.977748 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4bcdd282-122a-414e-b8b9-50b153c8704a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:39.183029 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-4bcdd282-122a-414e-b8b9-50b153c8704a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:39.193470 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4bcdd282-122a-414e-b8b9-50b153c8704a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.230776 May 16 17:41:39.194162 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 118/247] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:38 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:40.211272 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e6bd3fb5-3cc0-4b50-9d7f-294feffc03ed tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:40.211905 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e6bd3fb5-3cc0-4b50-9d7f-294feffc03ed tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:40.219007 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e6bd3fb5-3cc0-4b50-9d7f-294feffc03ed tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:40.219585 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e6bd3fb5-3cc0-4b50-9d7f-294feffc03ed tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:40.220704 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e6bd3fb5-3cc0-4b50-9d7f-294feffc03ed tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:40.221832 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e6bd3fb5-3cc0-4b50-9d7f-294feffc03ed tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:40.229933 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-821c1e7c-e51a-44b1-8b00-f5a426327c8c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "POST /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.225580 May 16 17:41:40.230543 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 130/248] 10.222.0.58 () {60 vars in 1322 bytes} [Mon May 16 17:41:38 2022] POST /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments => generated 194 bytes in 2227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:41:40.378756 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e6bd3fb5-3cc0-4b50-9d7f-294feffc03ed tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:40.388157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e6bd3fb5-3cc0-4b50-9d7f-294feffc03ed tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.181422 May 16 17:41:40.388826 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 119/249] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:40 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:41:41.407272 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-296fd699-9275-45fd-b2ff-3f70780654d7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:41.407954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-296fd699-9275-45fd-b2ff-3f70780654d7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:41.414310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-296fd699-9275-45fd-b2ff-3f70780654d7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:41.414753 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-296fd699-9275-45fd-b2ff-3f70780654d7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:41.415706 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-296fd699-9275-45fd-b2ff-3f70780654d7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:41.416135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-296fd699-9275-45fd-b2ff-3f70780654d7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:41.589644 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-296fd699-9275-45fd-b2ff-3f70780654d7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:41.598665 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-296fd699-9275-45fd-b2ff-3f70780654d7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.195908 May 16 17:41:41.599541 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 131/250] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:41 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:42.618560 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f0c400e7-cce3-433f-81f8-0e6874f9279d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:42.619171 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-f0c400e7-cce3-433f-81f8-0e6874f9279d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:42.638748 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f0c400e7-cce3-433f-81f8-0e6874f9279d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:42.639628 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f0c400e7-cce3-433f-81f8-0e6874f9279d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:42.640666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f0c400e7-cce3-433f-81f8-0e6874f9279d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:42.643155 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f0c400e7-cce3-433f-81f8-0e6874f9279d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:43.052680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f0c400e7-cce3-433f-81f8-0e6874f9279d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:43.065359 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f0c400e7-cce3-433f-81f8-0e6874f9279d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.451715 May 16 17:41:43.067196 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 120/251] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:42 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:44.093746 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-3055c960-1bc9-4865-9b03-dcdaad1c2af1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:44.097674 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-3055c960-1bc9-4865-9b03-dcdaad1c2af1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:44.113251 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3055c960-1bc9-4865-9b03-dcdaad1c2af1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:44.115398 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3055c960-1bc9-4865-9b03-dcdaad1c2af1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:44.117525 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3055c960-1bc9-4865-9b03-dcdaad1c2af1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:44.120270 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3055c960-1bc9-4865-9b03-dcdaad1c2af1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:44.369704 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3055c960-1bc9-4865-9b03-dcdaad1c2af1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:44.401719 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-3055c960-1bc9-4865-9b03-dcdaad1c2af1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.319709 May 16 17:41:44.402774 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 132/252] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:44 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:45.422377 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-50373c86-0eb7-4788-994e-b0f4d65e6633 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:45.423301 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-50373c86-0eb7-4788-994e-b0f4d65e6633 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:45.433775 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-50373c86-0eb7-4788-994e-b0f4d65e6633 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:45.434496 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-50373c86-0eb7-4788-994e-b0f4d65e6633 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:45.435288 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-50373c86-0eb7-4788-994e-b0f4d65e6633 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:45.435727 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-50373c86-0eb7-4788-994e-b0f4d65e6633 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:45.663047 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-50373c86-0eb7-4788-994e-b0f4d65e6633 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:45.675874 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-50373c86-0eb7-4788-994e-b0f4d65e6633 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.257873 May 16 17:41:45.676963 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 121/253] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:45 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:46.698496 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-660497ba-41ac-41db-8438-16a6ad646382 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:46.699189 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-660497ba-41ac-41db-8438-16a6ad646382 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:46.708688 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-660497ba-41ac-41db-8438-16a6ad646382 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:46.709851 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-660497ba-41ac-41db-8438-16a6ad646382 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:46.711934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-660497ba-41ac-41db-8438-16a6ad646382 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:46.713267 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-660497ba-41ac-41db-8438-16a6ad646382 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:46.912712 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-660497ba-41ac-41db-8438-16a6ad646382 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:46.934115 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-660497ba-41ac-41db-8438-16a6ad646382 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.240187 May 16 17:41:46.935064 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 133/254] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:46 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:47.952638 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-968cfc49-ce5e-4d11-a2ad-823fed394be4 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:47.953847 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-968cfc49-ce5e-4d11-a2ad-823fed394be4 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:47.960374 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-968cfc49-ce5e-4d11-a2ad-823fed394be4 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:47.961136 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-968cfc49-ce5e-4d11-a2ad-823fed394be4 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:47.962100 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-968cfc49-ce5e-4d11-a2ad-823fed394be4 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:47.962567 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-968cfc49-ce5e-4d11-a2ad-823fed394be4 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:47.983729 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d5807669-8abd-4ebf-813c-8e560747ad70 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Action: 'create', calling method: .version_select at 0x7f79a52fcee0>, body: {"keypair": {"name": "tempest-keypair-1136987100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKY0g27si5HMpGaQV4OEuKyuqlq6XtrizwuJ6PMbpqUBn8chl9WoVcu2UZkAQ8nuqco4/D/nzaqlinLUFTfjXWgC4wy08ezCXGxSjogSM2ZBfvpVC+EoLO1ZRtWBRFjcZQ=="}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:41:48.027398 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-d5807669-8abd-4ebf-813c-8e560747ad70 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Getting quotas for project 80c60c24806542e889c070d519172e79. Resources: {'key_pairs'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:41:48.035697 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-d5807669-8abd-4ebf-813c-8e560747ad70 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Getting quotas for user 6838738598ce4d2186e7c0b6547868f6 and project 80c60c24806542e889c070d519172e79. Resources: {'key_pairs'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:41:48.108623 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d5807669-8abd-4ebf-813c-8e560747ad70 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126668 May 16 17:41:48.109281 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 134/255] 10.222.0.58 () {60 vars in 1158 bytes} [Mon May 16 17:41:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:41:48.168170 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-968cfc49-ce5e-4d11-a2ad-823fed394be4 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:48.179329 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-968cfc49-ce5e-4d11-a2ad-823fed394be4 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.230585 May 16 17:41:48.180066 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 122/256] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:47 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:49.196368 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-100bb16f-df44-4a23-945f-57bd63117994 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:49.197652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-100bb16f-df44-4a23-945f-57bd63117994 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:49.205845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-100bb16f-df44-4a23-945f-57bd63117994 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:49.206381 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-100bb16f-df44-4a23-945f-57bd63117994 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:49.210385 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-100bb16f-df44-4a23-945f-57bd63117994 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:49.211007 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-100bb16f-df44-4a23-945f-57bd63117994 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:49.695029 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-100bb16f-df44-4a23-945f-57bd63117994 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:49.707670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-100bb16f-df44-4a23-945f-57bd63117994 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.515238 May 16 17:41:49.708260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 135/257] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:49 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:50.373328 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-8a3f1d8f-af0e-448d-947a-34e87ef21d05 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-988023574", "imageRef": "782bd628-ef1b-419c-99f5-2c312d1766a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28ed5c22-d613-46a9-98e4-5aa888da0e5a"}], "security_groups": [{"name": "tempest-securitygroup--899734352"}], "key_name": "tempest-keypair-1136987100", "user_data": "}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:41:50.727174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0b1793ce-6d94-4e76-9c31-53960fa549c0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:50.728244 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-0b1793ce-6d94-4e76-9c31-53960fa549c0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:50.740377 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0b1793ce-6d94-4e76-9c31-53960fa549c0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:50.741370 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0b1793ce-6d94-4e76-9c31-53960fa549c0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:50.743277 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0b1793ce-6d94-4e76-9c31-53960fa549c0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:50.744739 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0b1793ce-6d94-4e76-9c31-53960fa549c0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:50.932868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-0b1793ce-6d94-4e76-9c31-53960fa549c0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:50.940964 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-0b1793ce-6d94-4e76-9c31-53960fa549c0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.218623 May 16 17:41:50.950226 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 136/258] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:50 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:51.961886 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-c368776d-a4ca-421d-8b48-6a3ddecfddcc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:51.963099 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-c368776d-a4ca-421d-8b48-6a3ddecfddcc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:51.989058 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c368776d-a4ca-421d-8b48-6a3ddecfddcc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:51.990513 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c368776d-a4ca-421d-8b48-6a3ddecfddcc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:51.991630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c368776d-a4ca-421d-8b48-6a3ddecfddcc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:51.995993 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c368776d-a4ca-421d-8b48-6a3ddecfddcc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:52.304682 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-c368776d-a4ca-421d-8b48-6a3ddecfddcc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:52.325394 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-c368776d-a4ca-421d-8b48-6a3ddecfddcc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.370941 May 16 17:41:52.335697 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 137/259] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:51 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:53.352364 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5f40a143-72c3-4219-a293-4b914446d392 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:53.353900 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-5f40a143-72c3-4219-a293-4b914446d392 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:53.360660 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5f40a143-72c3-4219-a293-4b914446d392 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:53.361392 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5f40a143-72c3-4219-a293-4b914446d392 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:53.362200 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5f40a143-72c3-4219-a293-4b914446d392 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:53.362644 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5f40a143-72c3-4219-a293-4b914446d392 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:53.524978 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-5f40a143-72c3-4219-a293-4b914446d392 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:53.538501 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-5f40a143-72c3-4219-a293-4b914446d392 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.190013 May 16 17:41:53.539273 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 138/260] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:53 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:54.558428 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-86884001-3584-4335-afde-7c0a987ff4e6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:54.559586 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-86884001-3584-4335-afde-7c0a987ff4e6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:54.567623 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-86884001-3584-4335-afde-7c0a987ff4e6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:54.568484 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-86884001-3584-4335-afde-7c0a987ff4e6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:54.569854 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-86884001-3584-4335-afde-7c0a987ff4e6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:54.570648 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-86884001-3584-4335-afde-7c0a987ff4e6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:54.720022 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-86884001-3584-4335-afde-7c0a987ff4e6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:54.727418 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-86884001-3584-4335-afde-7c0a987ff4e6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.173813 May 16 17:41:54.728034 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 139/261] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:54 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:41:55.263426 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-38c398d2-28f8-4784-814e-4a525ebd939d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1557664163", "imageRef": "782bd628-ef1b-419c-99f5-2c312d1766a6", "flavorRef": "452"}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:41:56.330419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.network.neutron [None req-38c398d2-28f8-4784-814e-4a525ebd939d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] validate_networks() for None {{(pid=128815) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:41:56.373951 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.network.neutron [None req-8a3f1d8f-af0e-448d-947a-34e87ef21d05 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] validate_networks() for [('28ed5c22-d613-46a9-98e4-5aa888da0e5a', None, None, None, None, None)] {{(pid=128816) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:41:56.850239 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-38c398d2-28f8-4784-814e-4a525ebd939d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Flavor limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:41:56.850647 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-38c398d2-28f8-4784-814e-4a525ebd939d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Image limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:41:56.851194 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-38c398d2-28f8-4784-814e-4a525ebd939d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Flavor pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:41:56.851620 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-38c398d2-28f8-4784-814e-4a525ebd939d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Image pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:41:56.852026 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-38c398d2-28f8-4784-814e-4a525ebd939d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:41:56.867158 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-38c398d2-28f8-4784-814e-4a525ebd939d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:56.867695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-38c398d2-28f8-4784-814e-4a525ebd939d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:56.868504 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-38c398d2-28f8-4784-814e-4a525ebd939d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:56.868956 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-38c398d2-28f8-4784-814e-4a525ebd939d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:56.909924 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-38c398d2-28f8-4784-814e-4a525ebd939d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Getting quotas for project 6b9ec3ed53c944d9a3a98f0ac5fb912b. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:41:56.914318 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-38c398d2-28f8-4784-814e-4a525ebd939d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Getting quotas for user d0cafd26354b442984abe52ab75883cd and project 6b9ec3ed53c944d9a3a98f0ac5fb912b. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:41:56.929211 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-38c398d2-28f8-4784-814e-4a525ebd939d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Going to run 1 instances... {{(pid=128815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:41:56.933529 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-38c398d2-28f8-4784-814e-4a525ebd939d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='782bd628-ef1b-419c-99f5-2c312d1766a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:41:57.006157 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-38c398d2-28f8-4784-814e-4a525ebd939d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.747874 May 16 17:41:57.012289 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 140/262] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:41:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 17:41:57.021082 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-a9ffb12c-22ee-42f3-a7c5-48710d21dd92 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:57.021930 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a9ffb12c-22ee-42f3-a7c5-48710d21dd92 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:57.030012 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a9ffb12c-22ee-42f3-a7c5-48710d21dd92 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:57.030764 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a9ffb12c-22ee-42f3-a7c5-48710d21dd92 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:57.031731 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a9ffb12c-22ee-42f3-a7c5-48710d21dd92 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:57.032649 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a9ffb12c-22ee-42f3-a7c5-48710d21dd92 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:57.423210 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-a9ffb12c-22ee-42f3-a7c5-48710d21dd92 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:57.436697 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-a9ffb12c-22ee-42f3-a7c5-48710d21dd92 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.422110 May 16 17:41:57.437954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 141/263] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:57 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:57.446406 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-579016ce-ca0c-4701-a44b-3422720f0e6f tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:57.448592 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-579016ce-ca0c-4701-a44b-3422720f0e6f tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:57.481275 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-8a3f1d8f-af0e-448d-947a-34e87ef21d05 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Flavor limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:41:57.482017 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-8a3f1d8f-af0e-448d-947a-34e87ef21d05 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Image limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:41:57.482404 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-8a3f1d8f-af0e-448d-947a-34e87ef21d05 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Flavor pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:41:57.482892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-8a3f1d8f-af0e-448d-947a-34e87ef21d05 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Image pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:41:57.483544 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-8a3f1d8f-af0e-448d-947a-34e87ef21d05 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:41:57.507715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8a3f1d8f-af0e-448d-947a-34e87ef21d05 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:57.508506 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8a3f1d8f-af0e-448d-947a-34e87ef21d05 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:57.509659 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8a3f1d8f-af0e-448d-947a-34e87ef21d05 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:57.510529 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8a3f1d8f-af0e-448d-947a-34e87ef21d05 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:57.539024 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-8a3f1d8f-af0e-448d-947a-34e87ef21d05 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Getting quotas for project 80c60c24806542e889c070d519172e79. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:41:57.544867 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-8a3f1d8f-af0e-448d-947a-34e87ef21d05 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Getting quotas for user 6838738598ce4d2186e7c0b6547868f6 and project 80c60c24806542e889c070d519172e79. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:41:57.557592 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-8a3f1d8f-af0e-448d-947a-34e87ef21d05 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Going to run 1 instances... {{(pid=128816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:41:57.561280 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-8a3f1d8f-af0e-448d-947a-34e87ef21d05 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='782bd628-ef1b-419c-99f5-2c312d1766a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:41:57.622602 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-579016ce-ca0c-4701-a44b-3422720f0e6f tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:57.632603 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-579016ce-ca0c-4701-a44b-3422720f0e6f tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1215 microversion: 2.1 time: 0.193502 May 16 17:41:57.638639 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 142/264] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:57 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1215 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:57.655565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-8a3f1d8f-af0e-448d-947a-34e87ef21d05 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 7.289391 May 16 17:41:57.663534 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 123/265] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:41:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 7299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:41:57.683550 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-3a02b317-e10c-4209-beb8-0e693a699b69 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:57.684330 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-3a02b317-e10c-4209-beb8-0e693a699b69 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:57.768309 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3a02b317-e10c-4209-beb8-0e693a699b69 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:57.776988 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-3a02b317-e10c-4209-beb8-0e693a699b69 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1241 microversion: 2.1 time: 0.104516 May 16 17:41:57.777573 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 143/266] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:57 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:58.456985 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-36f5e2dd-e7bd-4a0f-b00e-b12814c6043d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:58.457931 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-36f5e2dd-e7bd-4a0f-b00e-b12814c6043d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:58.465970 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-36f5e2dd-e7bd-4a0f-b00e-b12814c6043d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:58.466819 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-36f5e2dd-e7bd-4a0f-b00e-b12814c6043d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:58.467607 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-36f5e2dd-e7bd-4a0f-b00e-b12814c6043d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:58.468208 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-36f5e2dd-e7bd-4a0f-b00e-b12814c6043d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:58.634817 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-36f5e2dd-e7bd-4a0f-b00e-b12814c6043d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:58.644936 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-36f5e2dd-e7bd-4a0f-b00e-b12814c6043d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.194187 May 16 17:41:58.660964 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-46db0c02-b26d-4b35-943c-90a16633226e tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:58.663041 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-46db0c02-b26d-4b35-943c-90a16633226e tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:58.663544 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 124/267] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:58 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:58.683533 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-46db0c02-b26d-4b35-943c-90a16633226e tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:58.684665 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-46db0c02-b26d-4b35-943c-90a16633226e tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:58.686424 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-46db0c02-b26d-4b35-943c-90a16633226e tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:58.687324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-46db0c02-b26d-4b35-943c-90a16633226e tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:58.775614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-46db0c02-b26d-4b35-943c-90a16633226e tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:58.782947 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-46db0c02-b26d-4b35-943c-90a16633226e tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1267 microversion: 2.1 time: 0.134155 May 16 17:41:58.804459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-cea03e0e-a031-4597-8e55-90b00d31f6e8 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:58.804459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-cea03e0e-a031-4597-8e55-90b00d31f6e8 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:58.805020 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 144/268] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:58 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:41:58.808863 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cea03e0e-a031-4597-8e55-90b00d31f6e8 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:58.809522 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cea03e0e-a031-4597-8e55-90b00d31f6e8 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:58.810679 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cea03e0e-a031-4597-8e55-90b00d31f6e8 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:58.811286 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cea03e0e-a031-4597-8e55-90b00d31f6e8 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:58.958759 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-cea03e0e-a031-4597-8e55-90b00d31f6e8 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:58.965222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-cea03e0e-a031-4597-8e55-90b00d31f6e8 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1293 microversion: 2.1 time: 0.171952 May 16 17:41:58.966793 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 125/269] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:58 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1293 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:59.675121 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-08321a43-7b7d-4cad-b01c-23beb086c9fc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:59.677213 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-08321a43-7b7d-4cad-b01c-23beb086c9fc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:59.688194 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-08321a43-7b7d-4cad-b01c-23beb086c9fc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:59.688806 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-08321a43-7b7d-4cad-b01c-23beb086c9fc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:59.689682 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-08321a43-7b7d-4cad-b01c-23beb086c9fc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:59.690357 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-08321a43-7b7d-4cad-b01c-23beb086c9fc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:59.806969 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a13b062c-97bc-4740-9557-131058e197c3 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:59.809027 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a13b062c-97bc-4740-9557-131058e197c3 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:59.816970 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a13b062c-97bc-4740-9557-131058e197c3 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:59.817420 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a13b062c-97bc-4740-9557-131058e197c3 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:59.818230 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a13b062c-97bc-4740-9557-131058e197c3 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:59.821528 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a13b062c-97bc-4740-9557-131058e197c3 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:59.854783 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-08321a43-7b7d-4cad-b01c-23beb086c9fc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:59.874886 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-08321a43-7b7d-4cad-b01c-23beb086c9fc tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1501 microversion: 2.1 time: 0.202059 May 16 17:41:59.881447 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 145/270] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:59 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1501 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:41:59.886905 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8488042e-ed6e-45b9-8e79-4d189b6ca0b8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47dcc41d-2d89-48ca-b521-7ddb2c252680"}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:41:59.888405 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-8488042e-ed6e-45b9-8e79-4d189b6ca0b8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:59.894955 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8488042e-ed6e-45b9-8e79-4d189b6ca0b8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:59.895416 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8488042e-ed6e-45b9-8e79-4d189b6ca0b8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:59.896396 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8488042e-ed6e-45b9-8e79-4d189b6ca0b8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:59.897077 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8488042e-ed6e-45b9-8e79-4d189b6ca0b8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:59.923049 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-8488042e-ed6e-45b9-8e79-4d189b6ca0b8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] HTTP exception thrown: Cannot 'attach_volume' instance b033cd6f-aebe-48ae-aefd-f505e6f16bbc while it is in vm_state rescued May 16 17:41:59.923315 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-a13b062c-97bc-4740-9557-131058e197c3 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8488042e-ed6e-45b9-8e79-4d189b6ca0b8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Request method failure captured: May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: POST /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc/os-volume_attachments HTTP/1.1 May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 74 May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigox3Qmb4992kn72mY0kZabi3WWaMoKtsNJ81h1vGTu6lqq_JffhZxwNoadReBgNHMCVOBH4NrH9XXgD7nYDL--nkddztfIg0jyy7tVCW5L3LondFz79JY-50aJZtbJok48vYOP6Nqc0oTFz5yi_gn8jJF0uyZpp_zS0drwvaV5rtuvk May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 1eddf9ae85b940b8bd556f4cf66c0b79 May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1737598232 May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:41:59.925208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:41:59.926585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eddf9ae85b940b8bd556f4cf66c0b79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1eddf9ae85b940b8bd556f4cf66c0b79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1eddf9ae85b940b8bd556f4cf66c0b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eddf9ae85b940b8bd556f4cf66c0b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:41:59.926585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1737598232 May 16 17:41:59.926585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 1eddf9ae85b940b8bd556f4cf66c0b79 May 16 17:41:59.926585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1737598232 May 16 17:41:59.926585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-ServerRescueNegativeTestJSON-1737598232-project May 16 17:41:59.926585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:41:59.926585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:41:59.926585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: c482d82afb734e10a5a11070fcb5f736 May 16 17:41:59.926585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1737598232-project May 16 17:41:59.926585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: May 16 17:41:59.926585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {"volumeAttachment": {"volumeId": "47dcc41d-2d89-48ca-b521-7ddb2c252680"}} May 16 17:41:59.926585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Cannot 'attach_volume' instance b033cd6f-aebe-48ae-aefd-f505e6f16bbc while it is in vm_state rescued May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'server_id': 'b033cd6f-aebe-48ae-aefd-f505e6f16bbc', 'body': {'volumeAttachment': {'volumeId': '47dcc41d-2d89-48ca-b521-7ddb2c252680'}}} May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b033cd6f-aebe-48ae-aefd-f505e6f16bbc in vm_state rescued. Cannot attach_volume while the instance is in this state. May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:41:59.927345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b033cd6f-aebe-48ae-aefd-f505e6f16bbc while it is in vm_state rescued May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:41:59.928523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:41:59.929646 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:41:59.929646 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:41:59.929646 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b033cd6f-aebe-48ae-aefd-f505e6f16bbc while it is in vm_state rescued May 16 17:41:59.929646 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:41:59.930659 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8488042e-ed6e-45b9-8e79-4d189b6ca0b8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Returning 409 to user: Cannot 'attach_volume' instance b033cd6f-aebe-48ae-aefd-f505e6f16bbc while it is in vm_state rescued {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:41:59.931267 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-8488042e-ed6e-45b9-8e79-4d189b6ca0b8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "POST /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048541 May 16 17:41:59.933961 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a13b062c-97bc-4740-9557-131058e197c3 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1285 microversion: 2.1 time: 0.132973 May 16 17:41:59.934967 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 126/271] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:59 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:41:59.936496 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 146/272] 10.222.0.58 () {60 vars in 1322 bytes} [Mon May 16 17:41:59 2022] POST /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 16 17:41:59.952768 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b11917e5-be49-4f0d-858f-da0781087c16 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:41:59.953303 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b11917e5-be49-4f0d-858f-da0781087c16 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:59.965022 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b11917e5-be49-4f0d-858f-da0781087c16 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:59.965530 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b11917e5-be49-4f0d-858f-da0781087c16 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:59.966454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b11917e5-be49-4f0d-858f-da0781087c16 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:59.969651 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b11917e5-be49-4f0d-858f-da0781087c16 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:59.984037 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-04c6ffda-ec11-42f3-93a4-4a6c493ad9fa tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:41:59.984646 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-04c6ffda-ec11-42f3-93a4-4a6c493ad9fa tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:41:59.996377 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-04c6ffda-ec11-42f3-93a4-4a6c493ad9fa tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:41:59.996936 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-04c6ffda-ec11-42f3-93a4-4a6c493ad9fa tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:41:59.998849 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-04c6ffda-ec11-42f3-93a4-4a6c493ad9fa tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:00.000870 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-04c6ffda-ec11-42f3-93a4-4a6c493ad9fa tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:00.135534 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b11917e5-be49-4f0d-858f-da0781087c16 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "POST /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc/action" status: 202 len: 0 microversion: 2.1 time: 0.186512 May 16 17:42:00.139790 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 127/273] 10.222.0.58 () {60 vars in 1277 bytes} [Mon May 16 17:41:59 2022] POST /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:42:00.145946 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d30942c9-eaf7-430f-bcc8-0e840904a935 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:00.151978 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-04c6ffda-ec11-42f3-93a4-4a6c493ad9fa tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:00.157731 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d30942c9-eaf7-430f-bcc8-0e840904a935 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:00.163605 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-04c6ffda-ec11-42f3-93a4-4a6c493ad9fa tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1301 microversion: 2.1 time: 0.183213 May 16 17:42:00.168733 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 147/274] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:41:59 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1301 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:42:00.182221 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d30942c9-eaf7-430f-bcc8-0e840904a935 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:00.182942 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d30942c9-eaf7-430f-bcc8-0e840904a935 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:00.184022 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d30942c9-eaf7-430f-bcc8-0e840904a935 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:00.185236 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d30942c9-eaf7-430f-bcc8-0e840904a935 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:00.732840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d30942c9-eaf7-430f-bcc8-0e840904a935 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:00.749404 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d30942c9-eaf7-430f-bcc8-0e840904a935 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1509 microversion: 2.1 time: 0.607948 May 16 17:42:00.765201 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 128/275] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:00 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1509 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:00.955279 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4d6c2301-c5af-41a3-8196-1d52ff76120a tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:00.955945 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-4d6c2301-c5af-41a3-8196-1d52ff76120a tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:00.962440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4d6c2301-c5af-41a3-8196-1d52ff76120a tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:00.962849 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4d6c2301-c5af-41a3-8196-1d52ff76120a tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:00.963849 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4d6c2301-c5af-41a3-8196-1d52ff76120a tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:00.964440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4d6c2301-c5af-41a3-8196-1d52ff76120a tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:01.129979 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-4d6c2301-c5af-41a3-8196-1d52ff76120a tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:01.140757 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-4d6c2301-c5af-41a3-8196-1d52ff76120a tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1273 microversion: 2.1 time: 0.189700 May 16 17:42:01.152097 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 148/276] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:00 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1273 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:01.190837 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-1b465749-def6-4148-b536-71ce59928035 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:01.197270 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-1b465749-def6-4148-b536-71ce59928035 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:01.211054 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1b465749-def6-4148-b536-71ce59928035 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:01.211791 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1b465749-def6-4148-b536-71ce59928035 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:01.213692 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1b465749-def6-4148-b536-71ce59928035 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:01.214510 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1b465749-def6-4148-b536-71ce59928035 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:01.728832 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-1b465749-def6-4148-b536-71ce59928035 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:01.737932 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-1b465749-def6-4148-b536-71ce59928035 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1299 microversion: 2.1 time: 0.554803 May 16 17:42:01.744619 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 129/277] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:01 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1299 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:01.772930 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-bb517a3f-c1fe-4e3e-9c84-cb0887397d95 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:01.775439 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-bb517a3f-c1fe-4e3e-9c84-cb0887397d95 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:01.786811 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bb517a3f-c1fe-4e3e-9c84-cb0887397d95 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:01.790838 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bb517a3f-c1fe-4e3e-9c84-cb0887397d95 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:01.791888 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bb517a3f-c1fe-4e3e-9c84-cb0887397d95 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:01.792613 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bb517a3f-c1fe-4e3e-9c84-cb0887397d95 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:02.096503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-181e2841-2e1a-46a6-a435-57c440072e03 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-310315942", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-471635196", "security_groups": [{"name": "tempest-secgroup-smoke-537290825"}], "networks": [{"uuid": "75ebd0fd-d72e-49bb-bc75-84b4a9d3410a"}], "block_device_mapping_v2": [{"uuid": "be15a557-8089-4bc6-865f-7a789cf69820", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:42:02.336173 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.network.neutron [None req-181e2841-2e1a-46a6-a435-57c440072e03 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] validate_networks() for [('75ebd0fd-d72e-49bb-bc75-84b4a9d3410a', None, None, None, None, None)] {{(pid=128816) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:42:02.567526 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-bb517a3f-c1fe-4e3e-9c84-cb0887397d95 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:02.580541 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-bb517a3f-c1fe-4e3e-9c84-cb0887397d95 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1509 microversion: 2.1 time: 0.811795 May 16 17:42:02.581127 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 149/278] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:01 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1509 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:02.588539 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5c2a516e-9326-4eb6-8abc-fd863bd0d1ea tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:02.589383 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-5c2a516e-9326-4eb6-8abc-fd863bd0d1ea tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:02.597304 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5c2a516e-9326-4eb6-8abc-fd863bd0d1ea tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:02.598037 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5c2a516e-9326-4eb6-8abc-fd863bd0d1ea tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:02.598989 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5c2a516e-9326-4eb6-8abc-fd863bd0d1ea tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:02.600075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5c2a516e-9326-4eb6-8abc-fd863bd0d1ea tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:02.903384 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-5c2a516e-9326-4eb6-8abc-fd863bd0d1ea tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:02.912838 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-5c2a516e-9326-4eb6-8abc-fd863bd0d1ea tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1315 microversion: 2.1 time: 0.329006 May 16 17:42:02.913440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 150/279] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:02 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:02.931280 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-fbd7cba2-db46-48af-b42b-a2544ef898f5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:02.932179 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-fbd7cba2-db46-48af-b42b-a2544ef898f5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:02.944534 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fbd7cba2-db46-48af-b42b-a2544ef898f5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:02.945291 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fbd7cba2-db46-48af-b42b-a2544ef898f5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:02.951090 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fbd7cba2-db46-48af-b42b-a2544ef898f5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:02.951875 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fbd7cba2-db46-48af-b42b-a2544ef898f5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:03.442303 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-fbd7cba2-db46-48af-b42b-a2544ef898f5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:03.451662 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-fbd7cba2-db46-48af-b42b-a2544ef898f5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1366 microversion: 2.1 time: 0.527469 May 16 17:42:03.458964 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 151/280] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:02 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1366 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:03.478456 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-ea9211b2-4878-4924-87e6-83af1f8216b6 req-8b24fc33-0154-46ed-a799-cb9e038c1858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dfa2070-9612-437b-badd-71224db017b2", "tag": "29f2ac14-d56d-435d-b3f7-0732ac5ae67b"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:42:03.508446 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-ea9211b2-4878-4924-87e6-83af1f8216b6 req-8b24fc33-0154-46ed-a799-cb9e038c1858 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:03.508883 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-ea9211b2-4878-4924-87e6-83af1f8216b6 req-8b24fc33-0154-46ed-a799-cb9e038c1858 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:03.539578 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-ea9211b2-4878-4924-87e6-83af1f8216b6 req-8b24fc33-0154-46ed-a799-cb9e038c1858 service nova] Creating event network-changed:29f2ac14-d56d-435d-b3f7-0732ac5ae67b for instance 9dfa2070-9612-437b-badd-71224db017b2 on hv-cinder-83769 May 16 17:42:03.549304 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-ea9211b2-4878-4924-87e6-83af1f8216b6 req-8b24fc33-0154-46ed-a799-cb9e038c1858 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082282 May 16 17:42:03.550241 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 152/281] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:42:03.587297 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-181e2841-2e1a-46a6-a435-57c440072e03 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Flavor limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:42:03.588614 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-181e2841-2e1a-46a6-a435-57c440072e03 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Image limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:42:03.589208 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-181e2841-2e1a-46a6-a435-57c440072e03 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Flavor pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:42:03.589820 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-181e2841-2e1a-46a6-a435-57c440072e03 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Image pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:42:03.590398 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-181e2841-2e1a-46a6-a435-57c440072e03 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:42:03.598885 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-b9c9deb0-bc58-4b18-9a33-a0dfe710e32c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:03.600187 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b9c9deb0-bc58-4b18-9a33-a0dfe710e32c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:03.606890 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-181e2841-2e1a-46a6-a435-57c440072e03 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:03.607495 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-181e2841-2e1a-46a6-a435-57c440072e03 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:03.608470 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-181e2841-2e1a-46a6-a435-57c440072e03 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:03.609062 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-181e2841-2e1a-46a6-a435-57c440072e03 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:03.610208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b9c9deb0-bc58-4b18-9a33-a0dfe710e32c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:03.610866 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b9c9deb0-bc58-4b18-9a33-a0dfe710e32c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:03.611790 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b9c9deb0-bc58-4b18-9a33-a0dfe710e32c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:03.612366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b9c9deb0-bc58-4b18-9a33-a0dfe710e32c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:03.633607 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-181e2841-2e1a-46a6-a435-57c440072e03 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Getting quotas for project 7ee0e621e3c34c3bba8434228c575a84. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:42:03.638515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-181e2841-2e1a-46a6-a435-57c440072e03 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Getting quotas for user 1ae731332a684481bef208fe5bfc4866 and project 7ee0e621e3c34c3bba8434228c575a84. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:42:03.742766 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-181e2841-2e1a-46a6-a435-57c440072e03 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Going to run 1 instances... {{(pid=128816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:42:03.746262 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-181e2841-2e1a-46a6-a435-57c440072e03 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='be15a557-8089-4bc6-865f-7a789cf69820',volume_size=None,volume_type=None)] {{(pid=128816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:42:03.834418 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b9c9deb0-bc58-4b18-9a33-a0dfe710e32c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:03.844238 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-b9c9deb0-bc58-4b18-9a33-a0dfe710e32c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1509 microversion: 2.1 time: 0.249912 May 16 17:42:03.845000 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 153/282] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:03 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:42:03.923691 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-181e2841-2e1a-46a6-a435-57c440072e03 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.831518 May 16 17:42:03.924577 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 130/283] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:42:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 17:42:03.930575 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d2ef9b7f-ca6f-4553-8292-865168166504 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:03.931189 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d2ef9b7f-ca6f-4553-8292-865168166504 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:03.939294 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d2ef9b7f-ca6f-4553-8292-865168166504 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:03.939997 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d2ef9b7f-ca6f-4553-8292-865168166504 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:03.940931 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d2ef9b7f-ca6f-4553-8292-865168166504 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:03.941505 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d2ef9b7f-ca6f-4553-8292-865168166504 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:03.947261 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-efbef82a-572b-4afe-b66d-f20c9680533f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:03.947888 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-efbef82a-572b-4afe-b66d-f20c9680533f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:04.194088 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-efbef82a-572b-4afe-b66d-f20c9680533f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:04.206230 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-efbef82a-572b-4afe-b66d-f20c9680533f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1087 microversion: 2.1 time: 0.262730 May 16 17:42:04.221612 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 131/284] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:03 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1087 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:04.458305 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d2ef9b7f-ca6f-4553-8292-865168166504 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:04.470169 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d2ef9b7f-ca6f-4553-8292-865168166504 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1315 microversion: 2.1 time: 0.543484 May 16 17:42:04.472636 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 154/285] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:03 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:04.475609 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-949645e4-ffa2-4f54-9c40-5ea68eab011c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:04.476349 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-949645e4-ffa2-4f54-9c40-5ea68eab011c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:04.488395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-949645e4-ffa2-4f54-9c40-5ea68eab011c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:04.488841 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-949645e4-ffa2-4f54-9c40-5ea68eab011c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:04.491017 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-949645e4-ffa2-4f54-9c40-5ea68eab011c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:04.493194 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-949645e4-ffa2-4f54-9c40-5ea68eab011c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:04.744351 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-949645e4-ffa2-4f54-9c40-5ea68eab011c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:04.792232 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-949645e4-ffa2-4f54-9c40-5ea68eab011c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1366 microversion: 2.1 time: 0.317091 May 16 17:42:04.801979 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 132/286] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:04 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:04.861882 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-3c718a41-a716-44e2-ae18-7b40296c1c7a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:04.863174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-3c718a41-a716-44e2-ae18-7b40296c1c7a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:04.871280 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3c718a41-a716-44e2-ae18-7b40296c1c7a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:04.871980 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3c718a41-a716-44e2-ae18-7b40296c1c7a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:04.873021 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3c718a41-a716-44e2-ae18-7b40296c1c7a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:04.873683 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3c718a41-a716-44e2-ae18-7b40296c1c7a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:05.233212 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-3e4d7b15-63b4-450b-96ed-a806e8154fb9 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:05.234062 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-3e4d7b15-63b4-450b-96ed-a806e8154fb9 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:05.246123 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3e4d7b15-63b4-450b-96ed-a806e8154fb9 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:05.246740 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3e4d7b15-63b4-450b-96ed-a806e8154fb9 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:05.251025 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3e4d7b15-63b4-450b-96ed-a806e8154fb9 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:05.254478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3e4d7b15-63b4-450b-96ed-a806e8154fb9 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:05.364901 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3c718a41-a716-44e2-ae18-7b40296c1c7a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:05.378586 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-3c718a41-a716-44e2-ae18-7b40296c1c7a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1515 microversion: 2.1 time: 0.520870 May 16 17:42:05.380023 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 155/287] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:04 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1515 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:05.416865 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-3e4d7b15-63b4-450b-96ed-a806e8154fb9 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:05.432373 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-3e4d7b15-63b4-450b-96ed-a806e8154fb9 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1185 microversion: 2.1 time: 0.203475 May 16 17:42:05.433914 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 133/288] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:05 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1185 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:05.489987 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-51ad0d8f-ab56-41b1-b078-d3d34cb1583b tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:05.490633 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-51ad0d8f-ab56-41b1-b078-d3d34cb1583b tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:05.500390 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-51ad0d8f-ab56-41b1-b078-d3d34cb1583b tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:05.500864 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-51ad0d8f-ab56-41b1-b078-d3d34cb1583b tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:05.501660 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-51ad0d8f-ab56-41b1-b078-d3d34cb1583b tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:05.502102 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-51ad0d8f-ab56-41b1-b078-d3d34cb1583b tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:05.819496 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a157acb8-a6cc-4ee1-bed1-6dfc41396e51 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:05.821041 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a157acb8-a6cc-4ee1-bed1-6dfc41396e51 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:05.861405 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a157acb8-a6cc-4ee1-bed1-6dfc41396e51 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:05.864603 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a157acb8-a6cc-4ee1-bed1-6dfc41396e51 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:05.871927 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a157acb8-a6cc-4ee1-bed1-6dfc41396e51 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:05.873084 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a157acb8-a6cc-4ee1-bed1-6dfc41396e51 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:06.304687 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-51ad0d8f-ab56-41b1-b078-d3d34cb1583b tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:06.336986 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-51ad0d8f-ab56-41b1-b078-d3d34cb1583b tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1315 microversion: 2.1 time: 0.851400 May 16 17:42:06.339240 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 156/289] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:05 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1315 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:06.350737 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-16d5ba2a-1fcf-4912-9f72-bfb34c090985 req-5f27f87d-1d3f-4de4-8024-8c12f86e16d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc187581-b958-457b-8aca-7774e8416ada", "tag": "f9e656f2-4ff2-469e-ba68-5ee1c1275d29"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:42:06.373651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-16d5ba2a-1fcf-4912-9f72-bfb34c090985 req-5f27f87d-1d3f-4de4-8024-8c12f86e16d3 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:06.375122 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-16d5ba2a-1fcf-4912-9f72-bfb34c090985 req-5f27f87d-1d3f-4de4-8024-8c12f86e16d3 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:06.411378 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-16d5ba2a-1fcf-4912-9f72-bfb34c090985 req-5f27f87d-1d3f-4de4-8024-8c12f86e16d3 service nova] Creating event network-changed:f9e656f2-4ff2-469e-ba68-5ee1c1275d29 for instance cc187581-b958-457b-8aca-7774e8416ada on hv-cinder-83769 May 16 17:42:06.422071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-16d5ba2a-1fcf-4912-9f72-bfb34c090985 req-5f27f87d-1d3f-4de4-8024-8c12f86e16d3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080896 May 16 17:42:06.423606 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 157/290] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:42:06.454906 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-27bf7b6c-28f5-4a36-9552-fe77de35859d tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:06.455793 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-27bf7b6c-28f5-4a36-9552-fe77de35859d tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:06.465043 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-27bf7b6c-28f5-4a36-9552-fe77de35859d tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:06.466851 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-27bf7b6c-28f5-4a36-9552-fe77de35859d tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:06.468394 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-27bf7b6c-28f5-4a36-9552-fe77de35859d tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:06.469903 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-27bf7b6c-28f5-4a36-9552-fe77de35859d tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:06.482948 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-a157acb8-a6cc-4ee1-bed1-6dfc41396e51 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:06.498376 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a157acb8-a6cc-4ee1-bed1-6dfc41396e51 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1366 microversion: 2.1 time: 0.683794 May 16 17:42:06.499668 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 134/291] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:05 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1366 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:42:06.613332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-27bf7b6c-28f5-4a36-9552-fe77de35859d tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:06.629342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-27bf7b6c-28f5-4a36-9552-fe77de35859d tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1203 microversion: 2.1 time: 0.177654 May 16 17:42:06.641617 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 158/292] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:06 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1203 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:07.049012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-63669865-f68f-4d2b-8925-8728c45cae77 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Action: 'create', calling method: .version_select at 0x7f79a567e700>, body: {"keypair": {"name": "tempest-keypair-905877989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJac3mC9/Ptb51uQ0TyHjPuazZi5AxvvG/fICBB4UqZJCBYbKHuGJ2+UbTkZH2vPBMZNiKIyrRE7T87Tcub5LULgeUVqx1r6YOIHB7Koqr7Ae06JZFjYzp7xZ2M6l0YCw=="}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:42:07.064900 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-63669865-f68f-4d2b-8925-8728c45cae77 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Getting quotas for project 1eddf9ae85b940b8bd556f4cf66c0b79. Resources: {'key_pairs'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:42:07.070151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-63669865-f68f-4d2b-8925-8728c45cae77 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Getting quotas for user c482d82afb734e10a5a11070fcb5f736 and project 1eddf9ae85b940b8bd556f4cf66c0b79. Resources: {'key_pairs'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:42:07.105946 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-63669865-f68f-4d2b-8925-8728c45cae77 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060083 May 16 17:42:07.113539 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 135/293] 10.222.0.58 () {60 vars in 1158 bytes} [Mon May 16 17:42:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:42:07.355763 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-674947e0-ff24-4be6-8dda-44df21354663 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:07.356400 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-674947e0-ff24-4be6-8dda-44df21354663 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:07.371826 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-674947e0-ff24-4be6-8dda-44df21354663 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:07.371826 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-674947e0-ff24-4be6-8dda-44df21354663 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:07.372698 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-674947e0-ff24-4be6-8dda-44df21354663 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:07.373079 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-674947e0-ff24-4be6-8dda-44df21354663 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:07.524473 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a630fc27-27b3-47d6-a55b-470153c78364 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:07.525146 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a630fc27-27b3-47d6-a55b-470153c78364 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:07.539027 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a630fc27-27b3-47d6-a55b-470153c78364 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:07.541977 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a630fc27-27b3-47d6-a55b-470153c78364 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:07.543222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a630fc27-27b3-47d6-a55b-470153c78364 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:07.545062 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a630fc27-27b3-47d6-a55b-470153c78364 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:07.757418 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-674947e0-ff24-4be6-8dda-44df21354663 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:07.767604 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-674947e0-ff24-4be6-8dda-44df21354663 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1315 microversion: 2.1 time: 0.416013 May 16 17:42:07.775873 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 159/294] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:07 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:07.781232 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-effe27e7-5781-4195-8d92-704bb4aa4da6 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:07.781944 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-effe27e7-5781-4195-8d92-704bb4aa4da6 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:07.788700 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-effe27e7-5781-4195-8d92-704bb4aa4da6 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:07.789153 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-effe27e7-5781-4195-8d92-704bb4aa4da6 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:07.789962 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-effe27e7-5781-4195-8d92-704bb4aa4da6 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:07.790401 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-effe27e7-5781-4195-8d92-704bb4aa4da6 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:07.916562 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-effe27e7-5781-4195-8d92-704bb4aa4da6 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:07.930434 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-effe27e7-5781-4195-8d92-704bb4aa4da6 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1191 microversion: 2.1 time: 0.153060 May 16 17:42:07.931501 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 160/295] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:07 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1191 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:07.940377 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-a630fc27-27b3-47d6-a55b-470153c78364 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:07.949807 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a630fc27-27b3-47d6-a55b-470153c78364 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1366 microversion: 2.1 time: 0.438145 May 16 17:42:07.950584 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 136/296] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:07 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:08.702935 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-59103a81-d7df-4041-972a-0582d2879964 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-303946207", "imageRef": "782bd628-ef1b-419c-99f5-2c312d1766a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3aa429a-c40d-42bd-9dfe-fc635bd438c5"}], "security_groups": [{"name": "tempest-securitygroup--633343035"}], "key_name": "tempest-keypair-905877989", "user_data": "}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:42:08.787457 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-69870761-1518-45e7-a7c4-73c8c7399268 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:08.788932 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-69870761-1518-45e7-a7c4-73c8c7399268 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:08.795155 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-69870761-1518-45e7-a7c4-73c8c7399268 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:08.795603 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-69870761-1518-45e7-a7c4-73c8c7399268 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:08.796618 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-69870761-1518-45e7-a7c4-73c8c7399268 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:08.797285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-69870761-1518-45e7-a7c4-73c8c7399268 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:09.135287 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-69870761-1518-45e7-a7c4-73c8c7399268 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:09.144249 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-69870761-1518-45e7-a7c4-73c8c7399268 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1315 microversion: 2.1 time: 0.360881 May 16 17:42:09.145381 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 137/297] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:08 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:09.157518 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d82fd2bd-9d2d-4684-9b91-6f7e8ce3d195 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:09.158174 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d82fd2bd-9d2d-4684-9b91-6f7e8ce3d195 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:09.165251 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d82fd2bd-9d2d-4684-9b91-6f7e8ce3d195 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:09.165728 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d82fd2bd-9d2d-4684-9b91-6f7e8ce3d195 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:09.167176 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d82fd2bd-9d2d-4684-9b91-6f7e8ce3d195 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:09.167176 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d82fd2bd-9d2d-4684-9b91-6f7e8ce3d195 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:09.487458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.network.neutron [None req-59103a81-d7df-4041-972a-0582d2879964 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] validate_networks() for [('b3aa429a-c40d-42bd-9dfe-fc635bd438c5', None, None, None, None, None)] {{(pid=128815) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:42:09.592421 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d82fd2bd-9d2d-4684-9b91-6f7e8ce3d195 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:09.603412 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d82fd2bd-9d2d-4684-9b91-6f7e8ce3d195 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.456729 May 16 17:42:09.604486 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 138/298] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:09 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:09.610677 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-96eca687-1fcb-4cb4-832f-fc2088893717 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:09.611577 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-96eca687-1fcb-4cb4-832f-fc2088893717 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:09.618815 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-96eca687-1fcb-4cb4-832f-fc2088893717 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:09.620171 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-96eca687-1fcb-4cb4-832f-fc2088893717 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:09.621099 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-96eca687-1fcb-4cb4-832f-fc2088893717 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:09.621669 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-96eca687-1fcb-4cb4-832f-fc2088893717 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:10.055708 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-96eca687-1fcb-4cb4-832f-fc2088893717 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:10.068218 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-96eca687-1fcb-4cb4-832f-fc2088893717 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1366 microversion: 2.1 time: 0.462473 May 16 17:42:10.069432 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 139/299] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:09 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:10.173509 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-8309a05d-c259-42a9-b492-97226c5b3064 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:10.174480 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-8309a05d-c259-42a9-b492-97226c5b3064 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:10.185027 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8309a05d-c259-42a9-b492-97226c5b3064 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:10.187899 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8309a05d-c259-42a9-b492-97226c5b3064 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:10.188955 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8309a05d-c259-42a9-b492-97226c5b3064 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:10.189410 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8309a05d-c259-42a9-b492-97226c5b3064 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:10.937350 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-8309a05d-c259-42a9-b492-97226c5b3064 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:10.945369 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-8309a05d-c259-42a9-b492-97226c5b3064 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1315 microversion: 2.1 time: 0.786862 May 16 17:42:10.946643 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 140/300] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:10 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1315 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:42:10.952543 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-01151ac3-fefa-4da0-b2bb-2214959658ce tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:10.953574 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-01151ac3-fefa-4da0-b2bb-2214959658ce tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:10.961098 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-01151ac3-fefa-4da0-b2bb-2214959658ce tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:10.961894 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-01151ac3-fefa-4da0-b2bb-2214959658ce tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:10.964244 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-01151ac3-fefa-4da0-b2bb-2214959658ce tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:10.964763 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-01151ac3-fefa-4da0-b2bb-2214959658ce tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:11.006358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-59103a81-d7df-4041-972a-0582d2879964 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Flavor limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:42:11.006876 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-59103a81-d7df-4041-972a-0582d2879964 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Image limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:42:11.007250 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-59103a81-d7df-4041-972a-0582d2879964 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Flavor pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:42:11.007650 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-59103a81-d7df-4041-972a-0582d2879964 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Image pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:42:11.008062 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-59103a81-d7df-4041-972a-0582d2879964 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:42:11.023386 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-59103a81-d7df-4041-972a-0582d2879964 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:11.023840 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-59103a81-d7df-4041-972a-0582d2879964 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:11.024641 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-59103a81-d7df-4041-972a-0582d2879964 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:11.025072 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-59103a81-d7df-4041-972a-0582d2879964 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:11.069219 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-59103a81-d7df-4041-972a-0582d2879964 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Getting quotas for project 1eddf9ae85b940b8bd556f4cf66c0b79. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:42:11.079314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-59103a81-d7df-4041-972a-0582d2879964 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Getting quotas for user c482d82afb734e10a5a11070fcb5f736 and project 1eddf9ae85b940b8bd556f4cf66c0b79. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:42:11.105431 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-59103a81-d7df-4041-972a-0582d2879964 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Going to run 1 instances... {{(pid=128815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:42:11.110674 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-59103a81-d7df-4041-972a-0582d2879964 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='782bd628-ef1b-419c-99f5-2c312d1766a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:42:11.213537 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-59103a81-d7df-4041-972a-0582d2879964 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.513711 May 16 17:42:11.217635 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 161/301] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:42:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 2519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:42:11.225636 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4818d033-0462-4b71-a2a8-e1a514eed2f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:11.226958 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-4818d033-0462-4b71-a2a8-e1a514eed2f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:11.259891 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4818d033-0462-4b71-a2a8-e1a514eed2f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:11.260397 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4818d033-0462-4b71-a2a8-e1a514eed2f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:11.261834 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4818d033-0462-4b71-a2a8-e1a514eed2f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:11.262492 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4818d033-0462-4b71-a2a8-e1a514eed2f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:11.558240 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-01151ac3-fefa-4da0-b2bb-2214959658ce tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:11.575729 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-01151ac3-fefa-4da0-b2bb-2214959658ce tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.627135 May 16 17:42:11.580074 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 141/302] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:10 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:11.593133 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-fa844ef7-4ac7-4630-8da6-dd07120ac0a5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:11.594261 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-fa844ef7-4ac7-4630-8da6-dd07120ac0a5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:11.675846 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-4818d033-0462-4b71-a2a8-e1a514eed2f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:11.687580 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-4818d033-0462-4b71-a2a8-e1a514eed2f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1366 microversion: 2.1 time: 0.468441 May 16 17:42:11.693128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 162/303] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:11 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1366 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:11.707428 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-a02978e7-8049-4c95-8e71-6369b26ceafd req-ccf33d08-ad89-4703-bc81-2e62c6147748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "643ca394-14c0-407b-be2a-3616138ebdb6", "tag": "d3d402b3-9560-4542-9028-c21ffae8c316"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:42:11.719536 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-a02978e7-8049-4c95-8e71-6369b26ceafd req-ccf33d08-ad89-4703-bc81-2e62c6147748 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:11.720261 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-a02978e7-8049-4c95-8e71-6369b26ceafd req-ccf33d08-ad89-4703-bc81-2e62c6147748 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:11.734182 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-a02978e7-8049-4c95-8e71-6369b26ceafd req-ccf33d08-ad89-4703-bc81-2e62c6147748 service nova] Creating event network-changed:d3d402b3-9560-4542-9028-c21ffae8c316 for instance 643ca394-14c0-407b-be2a-3616138ebdb6 on hv-cinder-83769 May 16 17:42:11.749366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-a02978e7-8049-4c95-8e71-6369b26ceafd req-ccf33d08-ad89-4703-bc81-2e62c6147748 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047782 May 16 17:42:11.749858 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-fa844ef7-4ac7-4630-8da6-dd07120ac0a5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:11.751706 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 163/304] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:42:11.757874 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-fa844ef7-4ac7-4630-8da6-dd07120ac0a5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1244 microversion: 2.1 time: 0.175863 May 16 17:42:11.758710 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 142/305] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:11 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1244 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:11.965429 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-3154a1b2-cd56-4421-a448-e726d2831f68 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:11.966567 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-3154a1b2-cd56-4421-a448-e726d2831f68 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:11.981746 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3154a1b2-cd56-4421-a448-e726d2831f68 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:11.982173 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3154a1b2-cd56-4421-a448-e726d2831f68 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:11.988243 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3154a1b2-cd56-4421-a448-e726d2831f68 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:11.988890 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3154a1b2-cd56-4421-a448-e726d2831f68 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:12.233491 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3154a1b2-cd56-4421-a448-e726d2831f68 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:12.241864 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-3154a1b2-cd56-4421-a448-e726d2831f68 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1315 microversion: 2.1 time: 0.281786 May 16 17:42:12.242999 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 164/306] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:11 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:12.596287 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-149ab3b1-bb2b-4ab9-9711-aa369321c721 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:12.597488 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-149ab3b1-bb2b-4ab9-9711-aa369321c721 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:12.605723 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-149ab3b1-bb2b-4ab9-9711-aa369321c721 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:12.606470 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-149ab3b1-bb2b-4ab9-9711-aa369321c721 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:12.607504 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-149ab3b1-bb2b-4ab9-9711-aa369321c721 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:12.608023 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-149ab3b1-bb2b-4ab9-9711-aa369321c721 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:12.657491 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-0698d847-2148-4b17-88ed-66c9eeb5b22c req-43919e71-ccc7-47a4-9e0a-7ef8c00ffc85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfa2070-9612-437b-badd-71224db017b2", "name": "network-vif-plugged", "status": "completed", "tag": "29f2ac14-d56d-435d-b3f7-0732ac5ae67b"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:42:12.668654 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-0698d847-2148-4b17-88ed-66c9eeb5b22c req-43919e71-ccc7-47a4-9e0a-7ef8c00ffc85 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:12.669777 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-0698d847-2148-4b17-88ed-66c9eeb5b22c req-43919e71-ccc7-47a4-9e0a-7ef8c00ffc85 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:12.690664 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-0698d847-2148-4b17-88ed-66c9eeb5b22c req-43919e71-ccc7-47a4-9e0a-7ef8c00ffc85 service nova] Creating event network-vif-plugged:29f2ac14-d56d-435d-b3f7-0732ac5ae67b for instance 9dfa2070-9612-437b-badd-71224db017b2 on hv-cinder-83769 May 16 17:42:12.703004 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-0698d847-2148-4b17-88ed-66c9eeb5b22c req-43919e71-ccc7-47a4-9e0a-7ef8c00ffc85 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047630 May 16 17:42:12.705711 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 165/307] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:42:12.716520 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4b02c473-c6e4-45ca-b0dd-4221ba82bb0f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:12.719153 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-4b02c473-c6e4-45ca-b0dd-4221ba82bb0f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:12.736923 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4b02c473-c6e4-45ca-b0dd-4221ba82bb0f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:12.737734 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4b02c473-c6e4-45ca-b0dd-4221ba82bb0f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:12.738751 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4b02c473-c6e4-45ca-b0dd-4221ba82bb0f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:12.739324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4b02c473-c6e4-45ca-b0dd-4221ba82bb0f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:12.875482 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-149ab3b1-bb2b-4ab9-9711-aa369321c721 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:12.888876 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-149ab3b1-bb2b-4ab9-9711-aa369321c721 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.296548 May 16 17:42:12.901910 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 143/308] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:12 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:12.922104 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e29e0754-a76b-4cde-b93e-8a8e0cefdb0e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:12.922790 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e29e0754-a76b-4cde-b93e-8a8e0cefdb0e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:12.947760 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e29e0754-a76b-4cde-b93e-8a8e0cefdb0e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:12.948976 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e29e0754-a76b-4cde-b93e-8a8e0cefdb0e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:12.957654 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e29e0754-a76b-4cde-b93e-8a8e0cefdb0e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:12.958166 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e29e0754-a76b-4cde-b93e-8a8e0cefdb0e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:13.147454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e29e0754-a76b-4cde-b93e-8a8e0cefdb0e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:13.162017 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e29e0754-a76b-4cde-b93e-8a8e0cefdb0e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1304 microversion: 2.1 time: 0.258761 May 16 17:42:13.169597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 144/309] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:12 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1304 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:13.260453 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f239c258-3759-4f53-9d0a-c814719fde5b tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:13.261208 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-f239c258-3759-4f53-9d0a-c814719fde5b tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:13.269177 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f239c258-3759-4f53-9d0a-c814719fde5b tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:13.270133 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f239c258-3759-4f53-9d0a-c814719fde5b tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:13.271056 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f239c258-3759-4f53-9d0a-c814719fde5b tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:13.271777 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f239c258-3759-4f53-9d0a-c814719fde5b tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:13.284847 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-4b02c473-c6e4-45ca-b0dd-4221ba82bb0f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:13.302714 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-4b02c473-c6e4-45ca-b0dd-4221ba82bb0f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1366 microversion: 2.1 time: 0.593982 May 16 17:42:13.303305 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 166/310] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:12 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1366 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:13.517022 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f239c258-3759-4f53-9d0a-c814719fde5b tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:13.524528 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f239c258-3759-4f53-9d0a-c814719fde5b tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1315 microversion: 2.1 time: 0.269285 May 16 17:42:13.535122 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 145/311] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:13 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:42:13.917148 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0850ee0e-0da8-4032-a134-41a5b67efef5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:13.918178 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-0850ee0e-0da8-4032-a134-41a5b67efef5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:13.927929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0850ee0e-0da8-4032-a134-41a5b67efef5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:13.928698 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0850ee0e-0da8-4032-a134-41a5b67efef5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:13.929760 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0850ee0e-0da8-4032-a134-41a5b67efef5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:13.930279 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0850ee0e-0da8-4032-a134-41a5b67efef5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:14.180668 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-537ff8e9-be81-411a-b0e7-558cb944c5c9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:14.181385 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-537ff8e9-be81-411a-b0e7-558cb944c5c9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:14.190495 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-537ff8e9-be81-411a-b0e7-558cb944c5c9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:14.190948 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-537ff8e9-be81-411a-b0e7-558cb944c5c9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:14.191720 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-537ff8e9-be81-411a-b0e7-558cb944c5c9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:14.192695 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-537ff8e9-be81-411a-b0e7-558cb944c5c9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:14.275691 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-0850ee0e-0da8-4032-a134-41a5b67efef5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:14.283101 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-537ff8e9-be81-411a-b0e7-558cb944c5c9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:14.288036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-0850ee0e-0da8-4032-a134-41a5b67efef5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.384755 May 16 17:42:14.291344 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-537ff8e9-be81-411a-b0e7-558cb944c5c9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1302 microversion: 2.1 time: 0.114901 May 16 17:42:14.291918 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 146/312] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:14 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1302 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:14.300341 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 167/313] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:13 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:14.319932 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-5831e4e5-3fec-4ef5-8988-6d140f5509c4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:14.320848 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-5831e4e5-3fec-4ef5-8988-6d140f5509c4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:14.327303 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5831e4e5-3fec-4ef5-8988-6d140f5509c4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:14.327779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5831e4e5-3fec-4ef5-8988-6d140f5509c4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:14.328492 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5831e4e5-3fec-4ef5-8988-6d140f5509c4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:14.328985 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5831e4e5-3fec-4ef5-8988-6d140f5509c4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:14.543460 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-7a04c416-34f0-459f-86ed-579b71d551f7 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:14.544972 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-7a04c416-34f0-459f-86ed-579b71d551f7 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:14.547848 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-5831e4e5-3fec-4ef5-8988-6d140f5509c4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:14.560396 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-5831e4e5-3fec-4ef5-8988-6d140f5509c4 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1366 microversion: 2.1 time: 0.243529 May 16 17:42:14.560516 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7a04c416-34f0-459f-86ed-579b71d551f7 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:14.560516 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7a04c416-34f0-459f-86ed-579b71d551f7 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:14.560740 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 147/314] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:14 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:14.561086 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7a04c416-34f0-459f-86ed-579b71d551f7 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:14.568403 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7a04c416-34f0-459f-86ed-579b71d551f7 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:14.754116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-5e5a8636-83b8-473c-a1ea-3feb23cabba7 req-bb6712e2-a333-49ed-a6f9-fd2879873948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc187581-b958-457b-8aca-7774e8416ada", "name": "network-vif-plugged", "status": "completed", "tag": "f9e656f2-4ff2-469e-ba68-5ee1c1275d29"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:42:14.762261 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-5e5a8636-83b8-473c-a1ea-3feb23cabba7 req-bb6712e2-a333-49ed-a6f9-fd2879873948 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:14.762701 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-5e5a8636-83b8-473c-a1ea-3feb23cabba7 req-bb6712e2-a333-49ed-a6f9-fd2879873948 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:14.774131 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-5e5a8636-83b8-473c-a1ea-3feb23cabba7 req-bb6712e2-a333-49ed-a6f9-fd2879873948 service nova] Creating event network-vif-plugged:f9e656f2-4ff2-469e-ba68-5ee1c1275d29 for instance cc187581-b958-457b-8aca-7774e8416ada on hv-cinder-83769 May 16 17:42:14.779325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-5e5a8636-83b8-473c-a1ea-3feb23cabba7 req-bb6712e2-a333-49ed-a6f9-fd2879873948 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029009 May 16 17:42:14.780018 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 148/315] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:42:14.788561 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-7a04c416-34f0-459f-86ed-579b71d551f7 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:14.796453 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-7a04c416-34f0-459f-86ed-579b71d551f7 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1315 microversion: 2.1 time: 0.257948 May 16 17:42:14.797031 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 168/316] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:14 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:42:15.307967 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-50a4096b-f429-4070-b7ce-895cc24a8286 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:15.308467 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-1960ca59-d0aa-4918-9acc-bea0bbe66704 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:15.308979 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-1960ca59-d0aa-4918-9acc-bea0bbe66704 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:15.309783 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-50a4096b-f429-4070-b7ce-895cc24a8286 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:15.318393 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1960ca59-d0aa-4918-9acc-bea0bbe66704 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:15.318804 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1960ca59-d0aa-4918-9acc-bea0bbe66704 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:15.319842 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1960ca59-d0aa-4918-9acc-bea0bbe66704 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:15.320256 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1960ca59-d0aa-4918-9acc-bea0bbe66704 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:15.327700 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-50a4096b-f429-4070-b7ce-895cc24a8286 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:15.328470 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-50a4096b-f429-4070-b7ce-895cc24a8286 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:15.330252 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-50a4096b-f429-4070-b7ce-895cc24a8286 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:15.330769 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-50a4096b-f429-4070-b7ce-895cc24a8286 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:15.598706 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-50a4096b-f429-4070-b7ce-895cc24a8286 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:15.603628 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-1960ca59-d0aa-4918-9acc-bea0bbe66704 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:15.606643 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-50a4096b-f429-4070-b7ce-895cc24a8286 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.302935 May 16 17:42:15.607276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 149/317] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:15 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:15.616130 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-1960ca59-d0aa-4918-9acc-bea0bbe66704 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.307252 May 16 17:42:15.616130 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 169/318] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:15 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:15.619951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-1fe361b2-8a1c-45ca-a71d-152389319187 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:15.620570 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-1fe361b2-8a1c-45ca-a71d-152389319187 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:15.628554 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1fe361b2-8a1c-45ca-a71d-152389319187 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:15.629009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1fe361b2-8a1c-45ca-a71d-152389319187 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:15.629830 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1fe361b2-8a1c-45ca-a71d-152389319187 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:15.630260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1fe361b2-8a1c-45ca-a71d-152389319187 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:15.812479 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c0f9e9a2-04ac-4abd-abf7-dd098293ca26 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:15.813715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-c0f9e9a2-04ac-4abd-abf7-dd098293ca26 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:15.820181 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c0f9e9a2-04ac-4abd-abf7-dd098293ca26 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:15.820745 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c0f9e9a2-04ac-4abd-abf7-dd098293ca26 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:15.821627 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c0f9e9a2-04ac-4abd-abf7-dd098293ca26 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:15.822310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c0f9e9a2-04ac-4abd-abf7-dd098293ca26 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:15.839097 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-1fe361b2-8a1c-45ca-a71d-152389319187 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:15.846621 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-1fe361b2-8a1c-45ca-a71d-152389319187 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1366 microversion: 2.1 time: 0.233547 May 16 17:42:15.847478 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 170/319] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:15 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:16.055927 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-c0f9e9a2-04ac-4abd-abf7-dd098293ca26 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:16.065423 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-c0f9e9a2-04ac-4abd-abf7-dd098293ca26 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1465 microversion: 2.1 time: 0.256702 May 16 17:42:16.066354 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 150/320] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:15 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1465 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:42:16.116964 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-b4005f9f-d683-4fc6-b350-d9fd360542c6 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:16.117595 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b4005f9f-d683-4fc6-b350-d9fd360542c6 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:16.127341 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b4005f9f-d683-4fc6-b350-d9fd360542c6 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:16.128760 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b4005f9f-d683-4fc6-b350-d9fd360542c6 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:16.129695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b4005f9f-d683-4fc6-b350-d9fd360542c6 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:16.130362 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b4005f9f-d683-4fc6-b350-d9fd360542c6 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:16.174681 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b4005f9f-d683-4fc6-b350-d9fd360542c6 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Going to try to terminate instance {{(pid=128815) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:42:16.264352 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-b4005f9f-d683-4fc6-b350-d9fd360542c6 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 204 len: 0 microversion: 2.1 time: 0.151786 May 16 17:42:16.265052 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 171/321] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:42:16 2022] DELETE /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:42:16.277132 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f01488e9-9130-45d0-82a1-207d10b10da8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:16.277813 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-f01488e9-9130-45d0-82a1-207d10b10da8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:16.294577 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-37d26f06-04fb-41ca-b2fb-6d64bf6b0529 req-27600a6c-9822-40fa-bb02-1d8293f819f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae780970-4212-46bc-8038-69067eb4e039", "tag": "5942e31d-ecd1-4f97-9d8e-c38cb2323490"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:42:16.300451 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f01488e9-9130-45d0-82a1-207d10b10da8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:16.302655 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f01488e9-9130-45d0-82a1-207d10b10da8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:16.303927 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f01488e9-9130-45d0-82a1-207d10b10da8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:16.307515 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-37d26f06-04fb-41ca-b2fb-6d64bf6b0529 req-27600a6c-9822-40fa-bb02-1d8293f819f7 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:16.308607 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-37d26f06-04fb-41ca-b2fb-6d64bf6b0529 req-27600a6c-9822-40fa-bb02-1d8293f819f7 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:16.309283 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f01488e9-9130-45d0-82a1-207d10b10da8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:16.324407 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-37d26f06-04fb-41ca-b2fb-6d64bf6b0529 req-27600a6c-9822-40fa-bb02-1d8293f819f7 service nova] Creating event network-changed:5942e31d-ecd1-4f97-9d8e-c38cb2323490 for instance ae780970-4212-46bc-8038-69067eb4e039 on hv-cinder-83769 May 16 17:42:16.337980 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-37d26f06-04fb-41ca-b2fb-6d64bf6b0529 req-27600a6c-9822-40fa-bb02-1d8293f819f7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051513 May 16 17:42:16.339356 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 172/322] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:42:16.476951 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f01488e9-9130-45d0-82a1-207d10b10da8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:16.484431 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f01488e9-9130-45d0-82a1-207d10b10da8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1471 microversion: 2.1 time: 0.214977 May 16 17:42:16.485590 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 151/323] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:16 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1471 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:16.630236 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-afa83e23-a5b4-478a-b9d8-99951a190465 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:16.631752 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c1975842-82e9-4770-9780-9b576d9f6199 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:16.631991 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-afa83e23-a5b4-478a-b9d8-99951a190465 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:16.632794 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-c1975842-82e9-4770-9780-9b576d9f6199 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:16.642346 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c1975842-82e9-4770-9780-9b576d9f6199 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:16.642521 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-afa83e23-a5b4-478a-b9d8-99951a190465 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:16.642795 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c1975842-82e9-4770-9780-9b576d9f6199 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:16.643130 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-afa83e23-a5b4-478a-b9d8-99951a190465 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:16.643563 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c1975842-82e9-4770-9780-9b576d9f6199 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:16.643906 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-afa83e23-a5b4-478a-b9d8-99951a190465 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:16.644040 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c1975842-82e9-4770-9780-9b576d9f6199 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:16.644362 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-afa83e23-a5b4-478a-b9d8-99951a190465 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:16.838864 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-c1975842-82e9-4770-9780-9b576d9f6199 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:16.843474 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-afa83e23-a5b4-478a-b9d8-99951a190465 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:16.852498 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-c1975842-82e9-4770-9780-9b576d9f6199 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.226951 May 16 17:42:16.852723 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-afa83e23-a5b4-478a-b9d8-99951a190465 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.231048 May 16 17:42:16.853099 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 152/324] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:16 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:16.853393 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 173/325] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:16 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:16.867741 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4bac829a-6a9c-4d55-ad24-1b5b5101c0ee tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:16.868357 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4bac829a-6a9c-4d55-ad24-1b5b5101c0ee tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:16.874772 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4bac829a-6a9c-4d55-ad24-1b5b5101c0ee tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:16.875215 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4bac829a-6a9c-4d55-ad24-1b5b5101c0ee tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:16.876024 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4bac829a-6a9c-4d55-ad24-1b5b5101c0ee tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:16.876466 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4bac829a-6a9c-4d55-ad24-1b5b5101c0ee tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:17.014568 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-4bac829a-6a9c-4d55-ad24-1b5b5101c0ee tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:17.022371 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4bac829a-6a9c-4d55-ad24-1b5b5101c0ee tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1366 microversion: 2.1 time: 0.158813 May 16 17:42:17.022929 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 153/326] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:16 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:17.505486 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4738d280-f059-4bb8-afec-8e36bab3d1fd tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:17.506178 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-4738d280-f059-4bb8-afec-8e36bab3d1fd tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:17.515016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4738d280-f059-4bb8-afec-8e36bab3d1fd tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:17.515649 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4738d280-f059-4bb8-afec-8e36bab3d1fd tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:17.516673 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4738d280-f059-4bb8-afec-8e36bab3d1fd tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:17.517111 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4738d280-f059-4bb8-afec-8e36bab3d1fd tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:17.645486 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-4738d280-f059-4bb8-afec-8e36bab3d1fd tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:17.652848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-4738d280-f059-4bb8-afec-8e36bab3d1fd tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1471 microversion: 2.1 time: 0.153493 May 16 17:42:17.653470 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 174/327] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:17 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:17.871057 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-33760a3d-fb5f-4418-bd62-65b37e4b640c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:17.872052 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-33760a3d-fb5f-4418-bd62-65b37e4b640c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:17.879923 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-33760a3d-fb5f-4418-bd62-65b37e4b640c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:17.880766 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-33760a3d-fb5f-4418-bd62-65b37e4b640c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:17.880941 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9efe862f-72e8-4b9f-bdec-879a5cc749eb tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:17.882002 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-9efe862f-72e8-4b9f-bdec-879a5cc749eb tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:17.882559 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-33760a3d-fb5f-4418-bd62-65b37e4b640c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:17.883187 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-33760a3d-fb5f-4418-bd62-65b37e4b640c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:17.896403 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9efe862f-72e8-4b9f-bdec-879a5cc749eb tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:17.897530 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9efe862f-72e8-4b9f-bdec-879a5cc749eb tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:17.899216 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9efe862f-72e8-4b9f-bdec-879a5cc749eb tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:17.900080 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9efe862f-72e8-4b9f-bdec-879a5cc749eb tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:18.142551 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-33760a3d-fb5f-4418-bd62-65b37e4b640c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:18.151080 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-33760a3d-fb5f-4418-bd62-65b37e4b640c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.284567 May 16 17:42:18.151663 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 175/328] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:17 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:18.156134 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4f1b6788-39e8-4dda-86ec-b8e77d9606cf tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:18.156732 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-4f1b6788-39e8-4dda-86ec-b8e77d9606cf tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:18.162991 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4f1b6788-39e8-4dda-86ec-b8e77d9606cf tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:18.163441 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4f1b6788-39e8-4dda-86ec-b8e77d9606cf tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:18.164207 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4f1b6788-39e8-4dda-86ec-b8e77d9606cf tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:18.164637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4f1b6788-39e8-4dda-86ec-b8e77d9606cf tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:18.170354 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9efe862f-72e8-4b9f-bdec-879a5cc749eb tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:18.177983 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-9efe862f-72e8-4b9f-bdec-879a5cc749eb tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.311045 May 16 17:42:18.178649 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 154/329] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:17 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:18.293539 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-4f1b6788-39e8-4dda-86ec-b8e77d9606cf tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:18.301489 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-4f1b6788-39e8-4dda-86ec-b8e77d9606cf tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1555 microversion: 2.1 time: 0.148884 May 16 17:42:18.302081 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 176/330] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:18 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:18.317518 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-cc994eae-1eb3-4c68-9fb7-0269f640318d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:18.318051 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-cc994eae-1eb3-4c68-9fb7-0269f640318d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:18.324805 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cc994eae-1eb3-4c68-9fb7-0269f640318d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:18.325254 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cc994eae-1eb3-4c68-9fb7-0269f640318d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:18.326058 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cc994eae-1eb3-4c68-9fb7-0269f640318d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:18.326587 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cc994eae-1eb3-4c68-9fb7-0269f640318d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:18.414546 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-cc994eae-1eb3-4c68-9fb7-0269f640318d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100886 May 16 17:42:18.415950 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 155/331] 10.222.0.58 () {58 vars in 1274 bytes} [Mon May 16 17:42:18 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:42:18.672476 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5aa0f360-fe0d-4855-9b4c-81811c7edbf6 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:18.673070 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-5aa0f360-fe0d-4855-9b4c-81811c7edbf6 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:18.680051 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5aa0f360-fe0d-4855-9b4c-81811c7edbf6 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:18.680555 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5aa0f360-fe0d-4855-9b4c-81811c7edbf6 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:18.681717 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5aa0f360-fe0d-4855-9b4c-81811c7edbf6 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:18.682222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5aa0f360-fe0d-4855-9b4c-81811c7edbf6 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:18.839509 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-5aa0f360-fe0d-4855-9b4c-81811c7edbf6 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:18.848257 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-5aa0f360-fe0d-4855-9b4c-81811c7edbf6 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1471 microversion: 2.1 time: 0.181895 May 16 17:42:18.849087 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 177/332] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:18 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:42:19.168551 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-65d8cfc4-d489-4c57-b40a-565acbd058e0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:19.170347 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-65d8cfc4-d489-4c57-b40a-565acbd058e0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:19.176898 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-65d8cfc4-d489-4c57-b40a-565acbd058e0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:19.177340 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-65d8cfc4-d489-4c57-b40a-565acbd058e0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:19.178326 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-65d8cfc4-d489-4c57-b40a-565acbd058e0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:19.179471 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-65d8cfc4-d489-4c57-b40a-565acbd058e0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:19.196477 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-94edbd1b-e670-4eef-90ce-4478a3a071a7 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:19.197092 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-94edbd1b-e670-4eef-90ce-4478a3a071a7 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:19.204975 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-94edbd1b-e670-4eef-90ce-4478a3a071a7 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:19.213787 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-94edbd1b-e670-4eef-90ce-4478a3a071a7 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:19.214716 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-94edbd1b-e670-4eef-90ce-4478a3a071a7 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:19.215205 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-94edbd1b-e670-4eef-90ce-4478a3a071a7 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:19.400046 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-65d8cfc4-d489-4c57-b40a-565acbd058e0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:19.408846 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-65d8cfc4-d489-4c57-b40a-565acbd058e0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.245240 May 16 17:42:19.409697 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 156/333] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:19 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:19.417693 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-94edbd1b-e670-4eef-90ce-4478a3a071a7 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:19.428035 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-94edbd1b-e670-4eef-90ce-4478a3a071a7 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.237533 May 16 17:42:19.428595 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 178/334] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:19 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:42:19.585729 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-fb528f46-5787-45fa-a179-2f8e3503cdac req-fbf9b3ff-cc24-458e-9de3-d284c9497756 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc187581-b958-457b-8aca-7774e8416ada", "tag": "f9e656f2-4ff2-469e-ba68-5ee1c1275d29"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:42:19.594008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-fb528f46-5787-45fa-a179-2f8e3503cdac req-fbf9b3ff-cc24-458e-9de3-d284c9497756 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:19.594439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-fb528f46-5787-45fa-a179-2f8e3503cdac req-fbf9b3ff-cc24-458e-9de3-d284c9497756 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:19.605283 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-fb528f46-5787-45fa-a179-2f8e3503cdac req-fbf9b3ff-cc24-458e-9de3-d284c9497756 service nova] Creating event network-changed:f9e656f2-4ff2-469e-ba68-5ee1c1275d29 for instance cc187581-b958-457b-8aca-7774e8416ada on hv-cinder-83769 May 16 17:42:19.610483 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-fb528f46-5787-45fa-a179-2f8e3503cdac req-fbf9b3ff-cc24-458e-9de3-d284c9497756 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028523 May 16 17:42:19.611239 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 157/335] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:42:19.867091 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-cc0d2e9e-4d56-4558-a8c9-48562c27fcd7 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:19.868296 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-cc0d2e9e-4d56-4558-a8c9-48562c27fcd7 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:19.874803 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cc0d2e9e-4d56-4558-a8c9-48562c27fcd7 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:19.875255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cc0d2e9e-4d56-4558-a8c9-48562c27fcd7 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:19.876182 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cc0d2e9e-4d56-4558-a8c9-48562c27fcd7 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:19.876430 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cc0d2e9e-4d56-4558-a8c9-48562c27fcd7 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:20.056924 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-cc0d2e9e-4d56-4558-a8c9-48562c27fcd7 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:20.065755 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-cc0d2e9e-4d56-4558-a8c9-48562c27fcd7 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1471 microversion: 2.1 time: 0.202942 May 16 17:42:20.066438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 179/336] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:19 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1471 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:20.429869 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a5eed891-7f59-4ea7-96f6-efefc12ac4d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:20.430711 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a5eed891-7f59-4ea7-96f6-efefc12ac4d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:20.437614 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a5eed891-7f59-4ea7-96f6-efefc12ac4d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:20.438203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a5eed891-7f59-4ea7-96f6-efefc12ac4d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:20.439082 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a5eed891-7f59-4ea7-96f6-efefc12ac4d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:20.439719 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a5eed891-7f59-4ea7-96f6-efefc12ac4d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:20.445713 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ce85d524-f4d5-43bc-ace5-bdaf072a30ad tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:20.446311 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ce85d524-f4d5-43bc-ace5-bdaf072a30ad tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:20.452342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ce85d524-f4d5-43bc-ace5-bdaf072a30ad tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:20.452812 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ce85d524-f4d5-43bc-ace5-bdaf072a30ad tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:20.453734 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ce85d524-f4d5-43bc-ace5-bdaf072a30ad tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:20.454171 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ce85d524-f4d5-43bc-ace5-bdaf072a30ad tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:20.642027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ce85d524-f4d5-43bc-ace5-bdaf072a30ad tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:20.645037 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-a5eed891-7f59-4ea7-96f6-efefc12ac4d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:20.650607 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ce85d524-f4d5-43bc-ace5-bdaf072a30ad tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.208741 May 16 17:42:20.651371 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 180/337] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:20 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:20.652862 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a5eed891-7f59-4ea7-96f6-efefc12ac4d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.230378 May 16 17:42:20.653461 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 158/338] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:20 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:21.086980 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-cd11c735-3131-48c2-b083-872e22f6d555 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:21.087948 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-cd11c735-3131-48c2-b083-872e22f6d555 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:21.099049 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cd11c735-3131-48c2-b083-872e22f6d555 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:21.099815 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cd11c735-3131-48c2-b083-872e22f6d555 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:21.101097 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cd11c735-3131-48c2-b083-872e22f6d555 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:21.101881 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cd11c735-3131-48c2-b083-872e22f6d555 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:21.239408 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-cd11c735-3131-48c2-b083-872e22f6d555 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:21.246928 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-cd11c735-3131-48c2-b083-872e22f6d555 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1471 microversion: 2.1 time: 0.166551 May 16 17:42:21.247502 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 181/339] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:21 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:21.668423 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-97784fb9-bb98-45c3-8f8b-3add3ab4a841 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:21.669276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-97784fb9-bb98-45c3-8f8b-3add3ab4a841 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:21.669639 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-dc0f9bb0-c0e8-4081-ad8b-c1a3c019bbb6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:21.670249 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-dc0f9bb0-c0e8-4081-ad8b-c1a3c019bbb6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:21.676937 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-97784fb9-bb98-45c3-8f8b-3add3ab4a841 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:21.677148 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dc0f9bb0-c0e8-4081-ad8b-c1a3c019bbb6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:21.677456 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-97784fb9-bb98-45c3-8f8b-3add3ab4a841 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:21.677607 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dc0f9bb0-c0e8-4081-ad8b-c1a3c019bbb6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:21.678426 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dc0f9bb0-c0e8-4081-ad8b-c1a3c019bbb6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:21.678658 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-97784fb9-bb98-45c3-8f8b-3add3ab4a841 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:21.678938 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dc0f9bb0-c0e8-4081-ad8b-c1a3c019bbb6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:21.679223 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-97784fb9-bb98-45c3-8f8b-3add3ab4a841 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:21.869857 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-dc0f9bb0-c0e8-4081-ad8b-c1a3c019bbb6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:21.873278 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-97784fb9-bb98-45c3-8f8b-3add3ab4a841 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:21.877720 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-dc0f9bb0-c0e8-4081-ad8b-c1a3c019bbb6 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.212158 May 16 17:42:21.878351 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 182/340] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:21 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:21.881003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-97784fb9-bb98-45c3-8f8b-3add3ab4a841 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.216806 May 16 17:42:21.881584 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 159/341] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:21 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:22.264085 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-035cc0ad-6a41-4f8a-8f07-14fefed61f75 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:22.264693 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-035cc0ad-6a41-4f8a-8f07-14fefed61f75 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:22.271577 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-035cc0ad-6a41-4f8a-8f07-14fefed61f75 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:22.272029 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-035cc0ad-6a41-4f8a-8f07-14fefed61f75 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:22.272787 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-035cc0ad-6a41-4f8a-8f07-14fefed61f75 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:22.273220 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-035cc0ad-6a41-4f8a-8f07-14fefed61f75 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:22.402521 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-035cc0ad-6a41-4f8a-8f07-14fefed61f75 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:22.410504 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-035cc0ad-6a41-4f8a-8f07-14fefed61f75 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1471 microversion: 2.1 time: 0.150352 May 16 17:42:22.411047 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 183/342] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:22 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:22.899013 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-27bc3a29-6d13-47f6-b8ed-a797b4d72564 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:22.899939 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-27bc3a29-6d13-47f6-b8ed-a797b4d72564 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:22.902126 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-22ffec2d-0257-413d-a17b-62b67d0f7a15 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:22.903168 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-22ffec2d-0257-413d-a17b-62b67d0f7a15 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:22.909770 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-27bc3a29-6d13-47f6-b8ed-a797b4d72564 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:22.910234 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-27bc3a29-6d13-47f6-b8ed-a797b4d72564 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:22.911008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-27bc3a29-6d13-47f6-b8ed-a797b4d72564 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:22.911150 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-22ffec2d-0257-413d-a17b-62b67d0f7a15 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:22.911447 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-27bc3a29-6d13-47f6-b8ed-a797b4d72564 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:22.911606 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-22ffec2d-0257-413d-a17b-62b67d0f7a15 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:22.912240 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-22ffec2d-0257-413d-a17b-62b67d0f7a15 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:22.912673 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-22ffec2d-0257-413d-a17b-62b67d0f7a15 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:23.111413 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-22ffec2d-0257-413d-a17b-62b67d0f7a15 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:23.118220 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-27bc3a29-6d13-47f6-b8ed-a797b4d72564 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:23.119172 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-22ffec2d-0257-413d-a17b-62b67d0f7a15 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.223680 May 16 17:42:23.119741 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 184/343] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:22 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:23.125580 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-27bc3a29-6d13-47f6-b8ed-a797b4d72564 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.233311 May 16 17:42:23.126185 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 160/344] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:22 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:23.428228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-bd313756-1a7f-4b9c-98b0-8a041edefb41 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:23.428823 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-bd313756-1a7f-4b9c-98b0-8a041edefb41 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:23.435427 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bd313756-1a7f-4b9c-98b0-8a041edefb41 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:23.435801 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bd313756-1a7f-4b9c-98b0-8a041edefb41 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:23.436547 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bd313756-1a7f-4b9c-98b0-8a041edefb41 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:23.436970 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bd313756-1a7f-4b9c-98b0-8a041edefb41 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:23.574378 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-bd313756-1a7f-4b9c-98b0-8a041edefb41 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:23.581978 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-bd313756-1a7f-4b9c-98b0-8a041edefb41 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1471 microversion: 2.1 time: 0.157569 May 16 17:42:23.582555 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 185/345] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:23 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:24.136357 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-88830207-95b6-4935-aa41-537e27f73b0b tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:24.136939 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-88830207-95b6-4935-aa41-537e27f73b0b tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:24.143588 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-88830207-95b6-4935-aa41-537e27f73b0b tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:24.144033 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-88830207-95b6-4935-aa41-537e27f73b0b tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:24.144777 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-88830207-95b6-4935-aa41-537e27f73b0b tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:24.145207 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-88830207-95b6-4935-aa41-537e27f73b0b tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:24.146633 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-deafe617-2da6-49e3-a486-588a77be38af tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:24.147231 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-deafe617-2da6-49e3-a486-588a77be38af tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:24.153855 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-deafe617-2da6-49e3-a486-588a77be38af tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:24.154296 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-deafe617-2da6-49e3-a486-588a77be38af tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:24.155058 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-deafe617-2da6-49e3-a486-588a77be38af tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:24.155483 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-deafe617-2da6-49e3-a486-588a77be38af tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:24.339908 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-88830207-95b6-4935-aa41-537e27f73b0b tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:24.344376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-deafe617-2da6-49e3-a486-588a77be38af tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:24.348241 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-88830207-95b6-4935-aa41-537e27f73b0b tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.215752 May 16 17:42:24.357328 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 161/346] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:24 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:24.357618 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-deafe617-2da6-49e3-a486-588a77be38af tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.210237 May 16 17:42:24.357618 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 186/347] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:24 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:24.601617 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-cc917c10-4422-4789-ac5f-3944438b159e tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:24.602577 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-cc917c10-4422-4789-ac5f-3944438b159e tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:24.612785 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cc917c10-4422-4789-ac5f-3944438b159e tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:24.613448 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cc917c10-4422-4789-ac5f-3944438b159e tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:24.614650 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cc917c10-4422-4789-ac5f-3944438b159e tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:24.615227 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cc917c10-4422-4789-ac5f-3944438b159e tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:24.761984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-cc917c10-4422-4789-ac5f-3944438b159e tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:24.770965 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-cc917c10-4422-4789-ac5f-3944438b159e tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1471 microversion: 2.1 time: 0.175364 May 16 17:42:24.771539 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 162/348] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:24 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:25.369200 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-beda47c1-075b-4b7e-865f-702f465659d5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:25.370261 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-beda47c1-075b-4b7e-865f-702f465659d5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:25.373933 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-043f2885-8202-4147-b07b-a12e0bcf1701 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:25.374961 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-043f2885-8202-4147-b07b-a12e0bcf1701 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:25.379477 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-beda47c1-075b-4b7e-865f-702f465659d5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:25.379907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-beda47c1-075b-4b7e-865f-702f465659d5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:25.380521 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-beda47c1-075b-4b7e-865f-702f465659d5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:25.380950 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-beda47c1-075b-4b7e-865f-702f465659d5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:25.381383 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-043f2885-8202-4147-b07b-a12e0bcf1701 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:25.381856 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-043f2885-8202-4147-b07b-a12e0bcf1701 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:25.382914 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-043f2885-8202-4147-b07b-a12e0bcf1701 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:25.383388 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-043f2885-8202-4147-b07b-a12e0bcf1701 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:25.571218 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-beda47c1-075b-4b7e-865f-702f465659d5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:25.579380 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-043f2885-8202-4147-b07b-a12e0bcf1701 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:25.580599 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-beda47c1-075b-4b7e-865f-702f465659d5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.217881 May 16 17:42:25.581152 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 187/349] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:25 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:25.587549 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-043f2885-8202-4147-b07b-a12e0bcf1701 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.220558 May 16 17:42:25.588317 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 163/350] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:25 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:25.794866 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-3057043d-ade2-4ba5-9ce2-41331ee67568 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:25.795859 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-3057043d-ade2-4ba5-9ce2-41331ee67568 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:25.802967 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3057043d-ade2-4ba5-9ce2-41331ee67568 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:25.803422 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3057043d-ade2-4ba5-9ce2-41331ee67568 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:25.804240 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3057043d-ade2-4ba5-9ce2-41331ee67568 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:25.804673 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3057043d-ade2-4ba5-9ce2-41331ee67568 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:25.939065 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3057043d-ade2-4ba5-9ce2-41331ee67568 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:25.946868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-3057043d-ade2-4ba5-9ce2-41331ee67568 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1471 microversion: 2.1 time: 0.161375 May 16 17:42:25.947418 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 188/351] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:25 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:26.601443 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-23e24de2-ddf9-430f-a003-377e8381cc09 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:26.602493 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-23e24de2-ddf9-430f-a003-377e8381cc09 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:26.607892 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-acf463c1-bca1-4f3f-9703-5c7f6bdffe0d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:26.608877 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-acf463c1-bca1-4f3f-9703-5c7f6bdffe0d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:26.611792 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-23e24de2-ddf9-430f-a003-377e8381cc09 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:26.612237 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-23e24de2-ddf9-430f-a003-377e8381cc09 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:26.613007 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-23e24de2-ddf9-430f-a003-377e8381cc09 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:26.613432 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-23e24de2-ddf9-430f-a003-377e8381cc09 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:26.616039 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-acf463c1-bca1-4f3f-9703-5c7f6bdffe0d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:26.616483 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-acf463c1-bca1-4f3f-9703-5c7f6bdffe0d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:26.617238 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-acf463c1-bca1-4f3f-9703-5c7f6bdffe0d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:26.617696 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-acf463c1-bca1-4f3f-9703-5c7f6bdffe0d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:26.807727 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-23e24de2-ddf9-430f-a003-377e8381cc09 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:26.811069 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-acf463c1-bca1-4f3f-9703-5c7f6bdffe0d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:26.815806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-23e24de2-ddf9-430f-a003-377e8381cc09 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.221091 May 16 17:42:26.816344 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 164/352] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:26 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:26.818772 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-acf463c1-bca1-4f3f-9703-5c7f6bdffe0d tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.217274 May 16 17:42:26.819344 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 189/353] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:26 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:26.968179 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-282cf303-6a81-4937-9585-006e1afe6ab4 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:26.969356 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-282cf303-6a81-4937-9585-006e1afe6ab4 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:26.975720 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-282cf303-6a81-4937-9585-006e1afe6ab4 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:26.976104 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-282cf303-6a81-4937-9585-006e1afe6ab4 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:26.976857 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-282cf303-6a81-4937-9585-006e1afe6ab4 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:26.977279 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-282cf303-6a81-4937-9585-006e1afe6ab4 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:27.108145 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-282cf303-6a81-4937-9585-006e1afe6ab4 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:27.116373 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-282cf303-6a81-4937-9585-006e1afe6ab4 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1471 microversion: 2.1 time: 0.154733 May 16 17:42:27.116940 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 165/354] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:26 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:27.836447 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-fe24ad74-dee9-426d-9fa0-9c759f220f93 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:27.837417 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-fe24ad74-dee9-426d-9fa0-9c759f220f93 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:27.841486 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-29425280-e5a6-4eec-a583-59286b13d967 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:27.842532 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-29425280-e5a6-4eec-a583-59286b13d967 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:27.848353 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fe24ad74-dee9-426d-9fa0-9c759f220f93 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:27.849111 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fe24ad74-dee9-426d-9fa0-9c759f220f93 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:27.850433 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fe24ad74-dee9-426d-9fa0-9c759f220f93 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:27.851152 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fe24ad74-dee9-426d-9fa0-9c759f220f93 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:27.854091 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-29425280-e5a6-4eec-a583-59286b13d967 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:27.855358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-29425280-e5a6-4eec-a583-59286b13d967 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:27.856728 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-29425280-e5a6-4eec-a583-59286b13d967 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:27.857446 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-29425280-e5a6-4eec-a583-59286b13d967 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:28.044823 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-29425280-e5a6-4eec-a583-59286b13d967 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:28.048236 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-fe24ad74-dee9-426d-9fa0-9c759f220f93 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:28.052614 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-29425280-e5a6-4eec-a583-59286b13d967 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.217794 May 16 17:42:28.053275 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 166/355] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:27 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:28.055797 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-fe24ad74-dee9-426d-9fa0-9c759f220f93 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.226004 May 16 17:42:28.056352 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 190/356] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:27 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:28.137341 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-eecd62cc-a7f2-4d08-b626-ece2b9bb00a4 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:28.138375 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-eecd62cc-a7f2-4d08-b626-ece2b9bb00a4 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:28.149100 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eecd62cc-a7f2-4d08-b626-ece2b9bb00a4 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:28.150534 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eecd62cc-a7f2-4d08-b626-ece2b9bb00a4 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:28.151854 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eecd62cc-a7f2-4d08-b626-ece2b9bb00a4 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:28.152588 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eecd62cc-a7f2-4d08-b626-ece2b9bb00a4 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:28.293060 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-eecd62cc-a7f2-4d08-b626-ece2b9bb00a4 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:28.301234 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-eecd62cc-a7f2-4d08-b626-ece2b9bb00a4 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1471 microversion: 2.1 time: 0.170150 May 16 17:42:28.301833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 167/357] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:28 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1471 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:29.070484 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-822e94f5-f880-4e5a-83b9-6a28fadcd965 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:29.071246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-822e94f5-f880-4e5a-83b9-6a28fadcd965 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:29.073626 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-2e49f04f-c4bd-4769-8701-c3a8939cdce4 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:29.074361 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-2e49f04f-c4bd-4769-8701-c3a8939cdce4 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:29.079916 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-822e94f5-f880-4e5a-83b9-6a28fadcd965 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:29.080589 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-822e94f5-f880-4e5a-83b9-6a28fadcd965 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:29.081697 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-822e94f5-f880-4e5a-83b9-6a28fadcd965 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:29.082243 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-822e94f5-f880-4e5a-83b9-6a28fadcd965 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:29.082678 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2e49f04f-c4bd-4769-8701-c3a8939cdce4 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:29.083271 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2e49f04f-c4bd-4769-8701-c3a8939cdce4 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:29.084176 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2e49f04f-c4bd-4769-8701-c3a8939cdce4 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:29.085229 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2e49f04f-c4bd-4769-8701-c3a8939cdce4 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:29.276741 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-822e94f5-f880-4e5a-83b9-6a28fadcd965 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:29.280560 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-2e49f04f-c4bd-4769-8701-c3a8939cdce4 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:29.284282 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-822e94f5-f880-4e5a-83b9-6a28fadcd965 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.218838 May 16 17:42:29.284894 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 191/358] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:29 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:29.288704 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-2e49f04f-c4bd-4769-8701-c3a8939cdce4 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.219913 May 16 17:42:29.289335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 168/359] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:29 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:29.319965 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-2a366b3f-a13f-401c-85ed-ec5dfb9b6be8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:29.320741 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-2a366b3f-a13f-401c-85ed-ec5dfb9b6be8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:29.326872 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2a366b3f-a13f-401c-85ed-ec5dfb9b6be8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:29.327326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2a366b3f-a13f-401c-85ed-ec5dfb9b6be8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:29.328083 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2a366b3f-a13f-401c-85ed-ec5dfb9b6be8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:29.328512 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2a366b3f-a13f-401c-85ed-ec5dfb9b6be8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:29.455590 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-2a366b3f-a13f-401c-85ed-ec5dfb9b6be8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:29.463676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-2a366b3f-a13f-401c-85ed-ec5dfb9b6be8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1471 microversion: 2.1 time: 0.147502 May 16 17:42:29.464244 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 192/360] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:29 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1471 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:30.305221 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-0f3ec8bb-64a4-4645-a939-269bd057f8f7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:30.306263 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-0f3ec8bb-64a4-4645-a939-269bd057f8f7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:30.309715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-96dca3a5-b953-46b9-b1a0-db7b044a5244 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:30.310796 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-96dca3a5-b953-46b9-b1a0-db7b044a5244 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:30.316769 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0f3ec8bb-64a4-4645-a939-269bd057f8f7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:30.317519 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0f3ec8bb-64a4-4645-a939-269bd057f8f7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:30.318802 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0f3ec8bb-64a4-4645-a939-269bd057f8f7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:30.319569 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0f3ec8bb-64a4-4645-a939-269bd057f8f7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:30.321367 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-96dca3a5-b953-46b9-b1a0-db7b044a5244 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:30.322163 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-96dca3a5-b953-46b9-b1a0-db7b044a5244 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:30.323448 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-96dca3a5-b953-46b9-b1a0-db7b044a5244 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:30.324153 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-96dca3a5-b953-46b9-b1a0-db7b044a5244 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:30.515632 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-0f3ec8bb-64a4-4645-a939-269bd057f8f7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:30.519432 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-96dca3a5-b953-46b9-b1a0-db7b044a5244 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:30.523636 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-0f3ec8bb-64a4-4645-a939-269bd057f8f7 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.224994 May 16 17:42:30.524210 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 169/361] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:30 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:30.526944 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-96dca3a5-b953-46b9-b1a0-db7b044a5244 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.223900 May 16 17:42:30.527493 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 193/362] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:30 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:30.528731 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-bfb78a91-5e99-4794-8925-b68a5f3d5cc8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:30.529299 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-bfb78a91-5e99-4794-8925-b68a5f3d5cc8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:30.535313 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bfb78a91-5e99-4794-8925-b68a5f3d5cc8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:30.535752 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bfb78a91-5e99-4794-8925-b68a5f3d5cc8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:30.536477 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bfb78a91-5e99-4794-8925-b68a5f3d5cc8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:30.536935 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bfb78a91-5e99-4794-8925-b68a5f3d5cc8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:30.666112 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-bfb78a91-5e99-4794-8925-b68a5f3d5cc8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:30.674031 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-bfb78a91-5e99-4794-8925-b68a5f3d5cc8 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1471 microversion: 2.1 time: 0.148808 May 16 17:42:30.674843 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 170/363] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:30 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:31.540727 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-042eabd4-0585-429f-bc95-3bed3b3c8dad tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:31.541439 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-042eabd4-0585-429f-bc95-3bed3b3c8dad tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:31.544059 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-3b581853-e5be-4e8a-bed6-e99156d58c23 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:31.544665 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-3b581853-e5be-4e8a-bed6-e99156d58c23 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:31.548319 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-042eabd4-0585-429f-bc95-3bed3b3c8dad tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:31.548781 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-042eabd4-0585-429f-bc95-3bed3b3c8dad tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:31.549576 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-042eabd4-0585-429f-bc95-3bed3b3c8dad tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:31.550002 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-042eabd4-0585-429f-bc95-3bed3b3c8dad tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:31.550862 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3b581853-e5be-4e8a-bed6-e99156d58c23 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:31.551308 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3b581853-e5be-4e8a-bed6-e99156d58c23 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:31.552061 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3b581853-e5be-4e8a-bed6-e99156d58c23 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:31.552491 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3b581853-e5be-4e8a-bed6-e99156d58c23 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:31.748412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-042eabd4-0585-429f-bc95-3bed3b3c8dad tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:31.757099 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-042eabd4-0585-429f-bc95-3bed3b3c8dad tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.220233 May 16 17:42:31.757239 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-3b581853-e5be-4e8a-bed6-e99156d58c23 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:31.758447 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 194/364] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:31 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:31.763825 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-9dac92c4-bbed-48e4-a772-a565db920491 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:31.764784 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-9dac92c4-bbed-48e4-a772-a565db920491 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:31.771795 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9dac92c4-bbed-48e4-a772-a565db920491 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:31.772587 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9dac92c4-bbed-48e4-a772-a565db920491 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:31.773577 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9dac92c4-bbed-48e4-a772-a565db920491 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:31.774266 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9dac92c4-bbed-48e4-a772-a565db920491 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:31.774897 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-3b581853-e5be-4e8a-bed6-e99156d58c23 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.234717 May 16 17:42:31.784855 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 171/365] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:31 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:42:31.913250 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-9dac92c4-bbed-48e4-a772-a565db920491 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:31.921183 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-9dac92c4-bbed-48e4-a772-a565db920491 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1471 microversion: 2.1 time: 0.161560 May 16 17:42:31.921782 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 195/366] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:31 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:32.774132 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-30c9dcac-081b-4fec-b907-6ffae0bc8bb1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:32.774780 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-30c9dcac-081b-4fec-b907-6ffae0bc8bb1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:32.781194 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-30c9dcac-081b-4fec-b907-6ffae0bc8bb1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:32.781730 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-30c9dcac-081b-4fec-b907-6ffae0bc8bb1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:32.782516 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-30c9dcac-081b-4fec-b907-6ffae0bc8bb1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:32.782950 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-30c9dcac-081b-4fec-b907-6ffae0bc8bb1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:32.791960 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-2d3355c7-fc23-49e0-8b45-2cf599956181 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:32.792851 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-2d3355c7-fc23-49e0-8b45-2cf599956181 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:32.800099 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2d3355c7-fc23-49e0-8b45-2cf599956181 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:32.800704 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2d3355c7-fc23-49e0-8b45-2cf599956181 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:32.801596 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2d3355c7-fc23-49e0-8b45-2cf599956181 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:32.802296 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2d3355c7-fc23-49e0-8b45-2cf599956181 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:33.166609 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-30c9dcac-081b-4fec-b907-6ffae0bc8bb1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:33.176309 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-30c9dcac-081b-4fec-b907-6ffae0bc8bb1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.406094 May 16 17:42:33.176882 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 172/367] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:32 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:33.182300 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-daa68e03-840a-4261-b334-c3f575381848 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:33.183110 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-daa68e03-840a-4261-b334-c3f575381848 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:33.190480 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-2d3355c7-fc23-49e0-8b45-2cf599956181 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:33.196543 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-daa68e03-840a-4261-b334-c3f575381848 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:33.197217 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-daa68e03-840a-4261-b334-c3f575381848 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:33.198620 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-daa68e03-840a-4261-b334-c3f575381848 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:33.199082 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-daa68e03-840a-4261-b334-c3f575381848 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:33.200803 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-2d3355c7-fc23-49e0-8b45-2cf599956181 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.412086 May 16 17:42:33.208821 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 196/368] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:32 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:33.433806 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-287e2061-caad-4db4-a164-41f3d9fbbb79 req-c7a5456c-2255-4663-96ab-75ae2080a644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfa2070-9612-437b-badd-71224db017b2", "name": "network-vif-deleted", "tag": "29f2ac14-d56d-435d-b3f7-0732ac5ae67b"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:42:33.435478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-daa68e03-840a-4261-b334-c3f575381848 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:33.443602 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-287e2061-caad-4db4-a164-41f3d9fbbb79 req-c7a5456c-2255-4663-96ab-75ae2080a644 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:33.443873 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-daa68e03-840a-4261-b334-c3f575381848 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1471 microversion: 2.1 time: 0.265803 May 16 17:42:33.444038 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-287e2061-caad-4db4-a164-41f3d9fbbb79 req-c7a5456c-2255-4663-96ab-75ae2080a644 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:33.444454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 173/369] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:33 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1471 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:33.455930 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-287e2061-caad-4db4-a164-41f3d9fbbb79 req-c7a5456c-2255-4663-96ab-75ae2080a644 service nova] Creating event network-vif-deleted:29f2ac14-d56d-435d-b3f7-0732ac5ae67b for instance 9dfa2070-9612-437b-badd-71224db017b2 on hv-cinder-83769 May 16 17:42:33.461318 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-287e2061-caad-4db4-a164-41f3d9fbbb79 req-c7a5456c-2255-4663-96ab-75ae2080a644 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032083 May 16 17:42:33.461961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 197/370] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:42:34.192629 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-735c17b4-a47c-4cad-8333-3b3e393acb7c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:34.193396 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-735c17b4-a47c-4cad-8333-3b3e393acb7c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:34.199339 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-735c17b4-a47c-4cad-8333-3b3e393acb7c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:34.199791 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-735c17b4-a47c-4cad-8333-3b3e393acb7c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:34.200595 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-735c17b4-a47c-4cad-8333-3b3e393acb7c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:34.201034 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-735c17b4-a47c-4cad-8333-3b3e393acb7c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:34.226499 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-212fa791-d04b-4927-9ce2-bade8de6d355 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:34.227808 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-212fa791-d04b-4927-9ce2-bade8de6d355 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:34.234394 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-212fa791-d04b-4927-9ce2-bade8de6d355 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:34.234804 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-212fa791-d04b-4927-9ce2-bade8de6d355 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:34.235588 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-212fa791-d04b-4927-9ce2-bade8de6d355 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:34.236023 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-212fa791-d04b-4927-9ce2-bade8de6d355 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:34.491269 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-212fa791-d04b-4927-9ce2-bade8de6d355 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:34.498418 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-735c17b4-a47c-4cad-8333-3b3e393acb7c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:34.510323 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-735c17b4-a47c-4cad-8333-3b3e393acb7c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.321385 May 16 17:42:34.511460 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-212fa791-d04b-4927-9ce2-bade8de6d355 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.287445 May 16 17:42:34.521246 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 174/371] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:34 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:34.522044 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 198/372] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:34 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:34.527477 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e55e9a5f-87a1-431a-8c0d-4f3dc6a3efe2 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:34.528088 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e55e9a5f-87a1-431a-8c0d-4f3dc6a3efe2 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:34.534533 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e55e9a5f-87a1-431a-8c0d-4f3dc6a3efe2 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:34.534980 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e55e9a5f-87a1-431a-8c0d-4f3dc6a3efe2 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:34.535757 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e55e9a5f-87a1-431a-8c0d-4f3dc6a3efe2 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:34.536366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e55e9a5f-87a1-431a-8c0d-4f3dc6a3efe2 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:34.572131 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e55e9a5f-87a1-431a-8c0d-4f3dc6a3efe2 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:34.572654 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e55e9a5f-87a1-431a-8c0d-4f3dc6a3efe2 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:34.573803 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-e55e9a5f-87a1-431a-8c0d-4f3dc6a3efe2 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lazy-loading 'fault' on Instance uuid 9dfa2070-9612-437b-badd-71224db017b2 {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:42:34.627370 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e55e9a5f-87a1-431a-8c0d-4f3dc6a3efe2 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cafd26354b442984abe52ab75883cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9ec3ed53c944d9a3a98f0ac5fb912b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:34.634457 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e55e9a5f-87a1-431a-8c0d-4f3dc6a3efe2 tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 200 len: 1305 microversion: 2.1 time: 0.111872 May 16 17:42:34.635227 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 175/373] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:34 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 1305 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:35.527533 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-a4c71019-5ae7-4855-951f-3940dcfa0960 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:35.528135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a4c71019-5ae7-4855-951f-3940dcfa0960 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:35.528532 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-15c02ac7-53e2-49e6-938d-3385a2007a81 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:35.529777 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-15c02ac7-53e2-49e6-938d-3385a2007a81 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:35.535418 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a4c71019-5ae7-4855-951f-3940dcfa0960 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:35.536126 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a4c71019-5ae7-4855-951f-3940dcfa0960 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:35.537169 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a4c71019-5ae7-4855-951f-3940dcfa0960 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:35.537364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-15c02ac7-53e2-49e6-938d-3385a2007a81 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:35.537797 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a4c71019-5ae7-4855-951f-3940dcfa0960 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:35.538260 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-15c02ac7-53e2-49e6-938d-3385a2007a81 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:35.539062 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-15c02ac7-53e2-49e6-938d-3385a2007a81 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:35.539538 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-15c02ac7-53e2-49e6-938d-3385a2007a81 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:35.749781 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-15c02ac7-53e2-49e6-938d-3385a2007a81 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:35.752490 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-a4c71019-5ae7-4855-951f-3940dcfa0960 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:35.758070 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-15c02ac7-53e2-49e6-938d-3385a2007a81 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.233682 May 16 17:42:35.759319 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 176/374] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:35 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:35.760862 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-a4c71019-5ae7-4855-951f-3940dcfa0960 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.237128 May 16 17:42:35.761424 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 199/375] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:35 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:35.769858 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-da7ce255-9940-470b-ab31-c1859045374d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:35.770389 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-da7ce255-9940-470b-ab31-c1859045374d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] [instance: 9dfa2070-9612-437b-badd-71224db017b2] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:35.776769 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-da7ce255-9940-470b-ab31-c1859045374d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:35.777255 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-da7ce255-9940-470b-ab31-c1859045374d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:35.778244 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-da7ce255-9940-470b-ab31-c1859045374d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:35.778680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-da7ce255-9940-470b-ab31-c1859045374d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:35.792511 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-da7ce255-9940-470b-ab31-c1859045374d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] HTTP exception thrown: Instance 9dfa2070-9612-437b-badd-71224db017b2 could not be found. May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-da7ce255-9940-470b-ab31-c1859045374d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Request method failure captured: May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 HTTP/1.1 May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigozhm2INhURVZaMUtIXj4sJkpSujJ1NKA7oK6RKa5y3sMqjeHE-FUzIeLeghFeDoAzXhgPt9O4RiEF3z4VyfaoOwoNSpvjoTr5I6Gq_B64vb9x9LAFF03qyOiDBCoMAzNyDvOVkVpVgBLMgxLE4aknDz7zVp2GEAca_-1gXewuWQ9E0 May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 6b9ec3ed53c944d9a3a98f0ac5fb912b May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-VolumesNegativeTest-2062945549 May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:42:35.794478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:42:35.796008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6b9ec3ed53c944d9a3a98f0ac5fb912b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6b9ec3ed53c944d9a3a98f0ac5fb912b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6b9ec3ed53c944d9a3a98f0ac5fb912b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6b9ec3ed53c944d9a3a98f0ac5fb912b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:42:35.796008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-VolumesNegativeTest-2062945549 May 16 17:42:35.796008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 6b9ec3ed53c944d9a3a98f0ac5fb912b May 16 17:42:35.796008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-VolumesNegativeTest-2062945549 May 16 17:42:35.796008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-VolumesNegativeTest-2062945549-project May 16 17:42:35.796008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:42:35.796008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:42:35.796008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: d0cafd26354b442984abe52ab75883cd May 16 17:42:35.796008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-VolumesNegativeTest-2062945549-project May 16 17:42:35.796008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:42:35.796008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance 9dfa2070-9612-437b-badd-71224db017b2 could not be found. May 16 17:42:35.796008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': '9dfa2070-9612-437b-badd-71224db017b2'} May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dfa2070-9612-437b-badd-71224db017b2 could not be found. May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:42:35.797012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:42:35.798508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:42:35.798508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:42:35.798508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:42:35.798508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:42:35.798508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:42:35.798508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:42:35.798508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:42:35.798508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dfa2070-9612-437b-badd-71224db017b2 could not be found. May 16 17:42:35.798508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:42:35.798508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:42:35.798508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:42:35.798508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:42:35.798508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:42:35.798508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:42:35.798508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:42:35.798508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:42:35.798508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dfa2070-9612-437b-badd-71224db017b2 could not be found. May 16 17:42:35.798508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:42:35.799798 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-da7ce255-9940-470b-ab31-c1859045374d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] Returning 404 to user: Instance 9dfa2070-9612-437b-badd-71224db017b2 could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:42:35.799798 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-da7ce255-9940-470b-ab31-c1859045374d tempest-VolumesNegativeTest-2062945549 tempest-VolumesNegativeTest-2062945549-project] 10.222.0.58 "GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2" status: 404 len: 111 microversion: 2.1 time: 0.035551 May 16 17:42:35.799798 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 177/376] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:35 2022] GET /compute/v2.1/servers/9dfa2070-9612-437b-badd-71224db017b2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:42:36.778519 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8c827140-299b-4d29-978c-f908878a8d27 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:36.779010 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f4fa9c04-2318-480c-9fd1-45d170321e2a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:36.779467 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-f4fa9c04-2318-480c-9fd1-45d170321e2a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:36.779761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-8c827140-299b-4d29-978c-f908878a8d27 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:36.787619 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f4fa9c04-2318-480c-9fd1-45d170321e2a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:36.788372 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f4fa9c04-2318-480c-9fd1-45d170321e2a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:36.789360 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f4fa9c04-2318-480c-9fd1-45d170321e2a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:36.790016 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f4fa9c04-2318-480c-9fd1-45d170321e2a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:36.793301 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8c827140-299b-4d29-978c-f908878a8d27 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:36.796555 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8c827140-299b-4d29-978c-f908878a8d27 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:36.797451 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8c827140-299b-4d29-978c-f908878a8d27 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:36.797923 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8c827140-299b-4d29-978c-f908878a8d27 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:37.086344 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f4fa9c04-2318-480c-9fd1-45d170321e2a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:37.095028 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f4fa9c04-2318-480c-9fd1-45d170321e2a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.321283 May 16 17:42:37.096029 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-8c827140-299b-4d29-978c-f908878a8d27 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:37.096487 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 178/377] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:36 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:42:37.101116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-215cf328-de2c-4ce4-82a3-c1f45b215bf5 req-55528552-0eae-4e66-8fef-4d83d30dee89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "643ca394-14c0-407b-be2a-3616138ebdb6", "name": "network-vif-plugged", "status": "completed", "tag": "d3d402b3-9560-4542-9028-c21ffae8c316"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:42:37.111030 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-215cf328-de2c-4ce4-82a3-c1f45b215bf5 req-55528552-0eae-4e66-8fef-4d83d30dee89 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:37.111466 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-215cf328-de2c-4ce4-82a3-c1f45b215bf5 req-55528552-0eae-4e66-8fef-4d83d30dee89 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:37.116526 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-8c827140-299b-4d29-978c-f908878a8d27 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.343683 May 16 17:42:37.117128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 200/378] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:36 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:37.128293 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-215cf328-de2c-4ce4-82a3-c1f45b215bf5 req-55528552-0eae-4e66-8fef-4d83d30dee89 service nova] Creating event network-vif-plugged:d3d402b3-9560-4542-9028-c21ffae8c316 for instance 643ca394-14c0-407b-be2a-3616138ebdb6 on hv-cinder-83769 May 16 17:42:37.137594 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-215cf328-de2c-4ce4-82a3-c1f45b215bf5 req-55528552-0eae-4e66-8fef-4d83d30dee89 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039403 May 16 17:42:37.138143 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 179/379] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:42:38.112647 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-3ed83b9b-12b0-4434-92d5-a6523a3276db tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:38.113283 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-3ed83b9b-12b0-4434-92d5-a6523a3276db tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:38.124157 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3ed83b9b-12b0-4434-92d5-a6523a3276db tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:38.124828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3ed83b9b-12b0-4434-92d5-a6523a3276db tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:38.125889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3ed83b9b-12b0-4434-92d5-a6523a3276db tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:38.126627 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3ed83b9b-12b0-4434-92d5-a6523a3276db tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:38.134810 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f4206572-064b-4138-85dd-5d0d79fd991e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:38.138136 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-f4206572-064b-4138-85dd-5d0d79fd991e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:38.153100 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f4206572-064b-4138-85dd-5d0d79fd991e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:38.153777 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f4206572-064b-4138-85dd-5d0d79fd991e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:38.155446 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f4206572-064b-4138-85dd-5d0d79fd991e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:38.156239 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f4206572-064b-4138-85dd-5d0d79fd991e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:38.378693 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f4206572-064b-4138-85dd-5d0d79fd991e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:38.381799 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3ed83b9b-12b0-4434-92d5-a6523a3276db tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:38.386792 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f4206572-064b-4138-85dd-5d0d79fd991e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.257932 May 16 17:42:38.387437 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 180/380] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:38 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:38.395884 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-3ed83b9b-12b0-4434-92d5-a6523a3276db tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.287253 May 16 17:42:38.396533 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 201/381] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:38 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:39.403644 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-8fe509e1-bbba-4821-87a6-6407c9fd66fb tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:39.404244 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-8fe509e1-bbba-4821-87a6-6407c9fd66fb tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:39.410518 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8fe509e1-bbba-4821-87a6-6407c9fd66fb tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:39.410931 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8fe509e1-bbba-4821-87a6-6407c9fd66fb tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:39.411728 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8fe509e1-bbba-4821-87a6-6407c9fd66fb tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:39.412144 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8fe509e1-bbba-4821-87a6-6407c9fd66fb tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:39.412283 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-58b1813a-ac78-4035-becc-7f74fa657579 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:39.412786 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-58b1813a-ac78-4035-becc-7f74fa657579 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:39.420079 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-58b1813a-ac78-4035-becc-7f74fa657579 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:39.420531 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-58b1813a-ac78-4035-becc-7f74fa657579 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:39.421277 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-58b1813a-ac78-4035-becc-7f74fa657579 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:39.421790 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-58b1813a-ac78-4035-becc-7f74fa657579 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:39.602756 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-58b1813a-ac78-4035-becc-7f74fa657579 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:39.606170 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-8fe509e1-bbba-4821-87a6-6407c9fd66fb tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:39.613875 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-8fe509e1-bbba-4821-87a6-6407c9fd66fb tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.214051 May 16 17:42:39.615719 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 181/382] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:39 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:39.619952 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-58b1813a-ac78-4035-becc-7f74fa657579 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.211505 May 16 17:42:39.628781 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 202/383] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:39 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:40.631086 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e970a3f3-b970-48ad-baaf-1cdfab88a910 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:40.631655 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e970a3f3-b970-48ad-baaf-1cdfab88a910 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:40.636272 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d5486f11-541e-4593-a29a-2ff50d790402 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:40.636899 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d5486f11-541e-4593-a29a-2ff50d790402 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:40.637504 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e970a3f3-b970-48ad-baaf-1cdfab88a910 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:40.637976 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e970a3f3-b970-48ad-baaf-1cdfab88a910 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:40.638732 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e970a3f3-b970-48ad-baaf-1cdfab88a910 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:40.639148 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e970a3f3-b970-48ad-baaf-1cdfab88a910 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:40.644076 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d5486f11-541e-4593-a29a-2ff50d790402 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:40.644527 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d5486f11-541e-4593-a29a-2ff50d790402 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:40.645334 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d5486f11-541e-4593-a29a-2ff50d790402 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:40.645805 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d5486f11-541e-4593-a29a-2ff50d790402 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:40.830679 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e970a3f3-b970-48ad-baaf-1cdfab88a910 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:40.833837 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d5486f11-541e-4593-a29a-2ff50d790402 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:40.838560 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e970a3f3-b970-48ad-baaf-1cdfab88a910 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1258 microversion: 2.1 time: 0.211563 May 16 17:42:40.839135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 182/384] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:40 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1258 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:40.841754 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d5486f11-541e-4593-a29a-2ff50d790402 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.209240 May 16 17:42:40.842291 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 203/385] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:40 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:41.792512 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-cb1d2f22-691d-456a-82e8-bb09b35ee1da req-22be3483-da8c-4209-9bf9-ce0874fd7535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae780970-4212-46bc-8038-69067eb4e039", "name": "network-vif-plugged", "status": "completed", "tag": "5942e31d-ecd1-4f97-9d8e-c38cb2323490"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:42:41.801286 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-cb1d2f22-691d-456a-82e8-bb09b35ee1da req-22be3483-da8c-4209-9bf9-ce0874fd7535 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:41.801748 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-cb1d2f22-691d-456a-82e8-bb09b35ee1da req-22be3483-da8c-4209-9bf9-ce0874fd7535 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:41.814463 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-cb1d2f22-691d-456a-82e8-bb09b35ee1da req-22be3483-da8c-4209-9bf9-ce0874fd7535 service nova] Creating event network-vif-plugged:5942e31d-ecd1-4f97-9d8e-c38cb2323490 for instance ae780970-4212-46bc-8038-69067eb4e039 on hv-cinder-83769 May 16 17:42:41.819421 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-cb1d2f22-691d-456a-82e8-bb09b35ee1da req-22be3483-da8c-4209-9bf9-ce0874fd7535 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030602 May 16 17:42:41.820489 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 183/386] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:42:41.856925 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4a5c11f8-2b87-4551-be5f-26d5950a4838 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:41.858024 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-4a5c11f8-2b87-4551-be5f-26d5950a4838 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:41.865970 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a915927c-6cd7-4e4f-9946-1934a30e81f5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:41.867109 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a915927c-6cd7-4e4f-9946-1934a30e81f5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:41.870996 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4a5c11f8-2b87-4551-be5f-26d5950a4838 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:41.872703 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4a5c11f8-2b87-4551-be5f-26d5950a4838 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:41.873748 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4a5c11f8-2b87-4551-be5f-26d5950a4838 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:41.875438 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a915927c-6cd7-4e4f-9946-1934a30e81f5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:41.875777 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4a5c11f8-2b87-4551-be5f-26d5950a4838 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:41.876019 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a915927c-6cd7-4e4f-9946-1934a30e81f5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:41.877061 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a915927c-6cd7-4e4f-9946-1934a30e81f5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:41.877495 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a915927c-6cd7-4e4f-9946-1934a30e81f5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:42.096356 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-4a5c11f8-2b87-4551-be5f-26d5950a4838 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:42.108524 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-a915927c-6cd7-4e4f-9946-1934a30e81f5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:42.112578 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-4a5c11f8-2b87-4551-be5f-26d5950a4838 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1443 microversion: 2.1 time: 0.260099 May 16 17:42:42.113180 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 204/387] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:41 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1443 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:42.129789 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ee2313ec-70ea-4307-8a6e-f149de916732 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:42.130553 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ee2313ec-70ea-4307-8a6e-f149de916732 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:42.131352 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a915927c-6cd7-4e4f-9946-1934a30e81f5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.275601 May 16 17:42:42.132144 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 184/388] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:41 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:42:42.140960 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ee2313ec-70ea-4307-8a6e-f149de916732 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:42.140960 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ee2313ec-70ea-4307-8a6e-f149de916732 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:42.140960 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ee2313ec-70ea-4307-8a6e-f149de916732 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:42.140960 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ee2313ec-70ea-4307-8a6e-f149de916732 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:42.287763 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ee2313ec-70ea-4307-8a6e-f149de916732 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:42.297960 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ee2313ec-70ea-4307-8a6e-f149de916732 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1443 microversion: 2.1 time: 0.172305 May 16 17:42:42.299401 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 205/389] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:42 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1443 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:42:43.149771 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-930f0854-cb63-451c-89e6-8f257b4b0651 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:43.150379 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-930f0854-cb63-451c-89e6-8f257b4b0651 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:43.156550 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-930f0854-cb63-451c-89e6-8f257b4b0651 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:43.156993 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-930f0854-cb63-451c-89e6-8f257b4b0651 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:43.157806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-930f0854-cb63-451c-89e6-8f257b4b0651 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:43.158246 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-930f0854-cb63-451c-89e6-8f257b4b0651 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:43.321898 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-930f0854-cb63-451c-89e6-8f257b4b0651 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:43.329570 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-930f0854-cb63-451c-89e6-8f257b4b0651 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.183642 May 16 17:42:43.330425 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 185/390] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:43 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:44.345989 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-af9b5be7-d6c4-49d4-bc8b-5f01fd6a3e4e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:44.346592 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-af9b5be7-d6c4-49d4-bc8b-5f01fd6a3e4e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:44.353324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-af9b5be7-d6c4-49d4-bc8b-5f01fd6a3e4e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:44.354061 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-af9b5be7-d6c4-49d4-bc8b-5f01fd6a3e4e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:44.354841 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-af9b5be7-d6c4-49d4-bc8b-5f01fd6a3e4e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:44.355281 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-af9b5be7-d6c4-49d4-bc8b-5f01fd6a3e4e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:44.377457 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-df397d79-7d64-4c4e-9bae-65b4a47d6c17 req-2f00c696-631a-48e6-a94f-446b582de315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "643ca394-14c0-407b-be2a-3616138ebdb6", "tag": "d3d402b3-9560-4542-9028-c21ffae8c316"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:42:44.385647 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-df397d79-7d64-4c4e-9bae-65b4a47d6c17 req-2f00c696-631a-48e6-a94f-446b582de315 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:44.386171 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-df397d79-7d64-4c4e-9bae-65b4a47d6c17 req-2f00c696-631a-48e6-a94f-446b582de315 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:44.398035 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-df397d79-7d64-4c4e-9bae-65b4a47d6c17 req-2f00c696-631a-48e6-a94f-446b582de315 service nova] Creating event network-changed:d3d402b3-9560-4542-9028-c21ffae8c316 for instance 643ca394-14c0-407b-be2a-3616138ebdb6 on hv-cinder-83769 May 16 17:42:44.403511 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-df397d79-7d64-4c4e-9bae-65b4a47d6c17 req-2f00c696-631a-48e6-a94f-446b582de315 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030114 May 16 17:42:44.404105 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 186/391] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:42:44.569525 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-af9b5be7-d6c4-49d4-bc8b-5f01fd6a3e4e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:44.577025 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-af9b5be7-d6c4-49d4-bc8b-5f01fd6a3e4e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.234836 May 16 17:42:44.577930 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 206/392] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:44 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:45.595090 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ed70b641-0e6e-4245-becb-2b49597bc4ea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:45.595750 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-ed70b641-0e6e-4245-becb-2b49597bc4ea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:45.603361 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ed70b641-0e6e-4245-becb-2b49597bc4ea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:45.603813 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ed70b641-0e6e-4245-becb-2b49597bc4ea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:45.604920 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ed70b641-0e6e-4245-becb-2b49597bc4ea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:45.606005 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ed70b641-0e6e-4245-becb-2b49597bc4ea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:45.739276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-ed70b641-0e6e-4245-becb-2b49597bc4ea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:45.747136 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ed70b641-0e6e-4245-becb-2b49597bc4ea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.156521 May 16 17:42:45.747708 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 187/393] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:45 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:46.767153 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-291569bf-501c-40d4-9aec-b8ec82dea9ea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:46.767743 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-291569bf-501c-40d4-9aec-b8ec82dea9ea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:46.774574 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-291569bf-501c-40d4-9aec-b8ec82dea9ea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:46.775048 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-291569bf-501c-40d4-9aec-b8ec82dea9ea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:46.775794 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-291569bf-501c-40d4-9aec-b8ec82dea9ea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:46.776225 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-291569bf-501c-40d4-9aec-b8ec82dea9ea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:46.906524 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-291569bf-501c-40d4-9aec-b8ec82dea9ea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:46.914783 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-291569bf-501c-40d4-9aec-b8ec82dea9ea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.153301 May 16 17:42:46.915292 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 207/394] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:46 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:47.936365 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-02cc29c0-dae7-4287-8fbe-2d0767eb8b63 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:47.937596 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-02cc29c0-dae7-4287-8fbe-2d0767eb8b63 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:47.944429 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-02cc29c0-dae7-4287-8fbe-2d0767eb8b63 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:47.944868 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-02cc29c0-dae7-4287-8fbe-2d0767eb8b63 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:47.945653 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-02cc29c0-dae7-4287-8fbe-2d0767eb8b63 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:47.946074 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-02cc29c0-dae7-4287-8fbe-2d0767eb8b63 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:48.077656 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-02cc29c0-dae7-4287-8fbe-2d0767eb8b63 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:48.085143 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-02cc29c0-dae7-4287-8fbe-2d0767eb8b63 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.155348 May 16 17:42:48.085778 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 188/395] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:47 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:49.102013 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ee846385-7910-4864-a897-95e3a63d09e0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:49.102568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ee846385-7910-4864-a897-95e3a63d09e0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:49.109101 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ee846385-7910-4864-a897-95e3a63d09e0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:49.109634 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ee846385-7910-4864-a897-95e3a63d09e0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:49.110416 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ee846385-7910-4864-a897-95e3a63d09e0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:49.110849 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ee846385-7910-4864-a897-95e3a63d09e0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:49.262012 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ee846385-7910-4864-a897-95e3a63d09e0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:49.270363 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ee846385-7910-4864-a897-95e3a63d09e0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.172343 May 16 17:42:49.270935 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 208/396] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:49 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:50.286974 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-6cf91674-6147-44a2-a3bb-8dc8384a4bf0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:50.287585 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-6cf91674-6147-44a2-a3bb-8dc8384a4bf0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:50.294177 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6cf91674-6147-44a2-a3bb-8dc8384a4bf0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:50.294693 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6cf91674-6147-44a2-a3bb-8dc8384a4bf0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:50.295646 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6cf91674-6147-44a2-a3bb-8dc8384a4bf0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:50.296210 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6cf91674-6147-44a2-a3bb-8dc8384a4bf0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:50.424185 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-6cf91674-6147-44a2-a3bb-8dc8384a4bf0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:50.431969 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-6cf91674-6147-44a2-a3bb-8dc8384a4bf0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1369 microversion: 2.1 time: 0.148908 May 16 17:42:50.432529 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 189/397] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:50 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:51.448910 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ed4f33e1-65e1-4fe8-b610-b22764017eea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:51.449528 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ed4f33e1-65e1-4fe8-b610-b22764017eea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:51.456121 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ed4f33e1-65e1-4fe8-b610-b22764017eea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:51.456553 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ed4f33e1-65e1-4fe8-b610-b22764017eea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:51.457524 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ed4f33e1-65e1-4fe8-b610-b22764017eea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:51.457967 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ed4f33e1-65e1-4fe8-b610-b22764017eea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:51.598564 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ed4f33e1-65e1-4fe8-b610-b22764017eea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:42:51.606223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ed4f33e1-65e1-4fe8-b610-b22764017eea tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1564 microversion: 2.1 time: 0.161362 May 16 17:42:51.606804 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 209/398] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:42:51 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:42:51.625243 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-763a4f08-35c3-49b6-a06c-e2fdefc57736 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:42:51.625835 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-763a4f08-35c3-49b6-a06c-e2fdefc57736 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:42:51.632157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-763a4f08-35c3-49b6-a06c-e2fdefc57736 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:51.632606 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-763a4f08-35c3-49b6-a06c-e2fdefc57736 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:51.633367 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-763a4f08-35c3-49b6-a06c-e2fdefc57736 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:51.633839 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-763a4f08-35c3-49b6-a06c-e2fdefc57736 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:51.718678 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-763a4f08-35c3-49b6-a06c-e2fdefc57736 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099351 May 16 17:42:51.719279 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 190/399] 10.222.0.58 () {58 vars in 1274 bytes} [Mon May 16 17:42:51 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:42:52.674329 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-63a07aac-2bea-444e-b3ad-d8e51ad2d0e3 req-36e41cb7-e31d-45a0-923a-7bf6bb74c375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae780970-4212-46bc-8038-69067eb4e039", "tag": "5942e31d-ecd1-4f97-9d8e-c38cb2323490"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:42:52.683028 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-63a07aac-2bea-444e-b3ad-d8e51ad2d0e3 req-36e41cb7-e31d-45a0-923a-7bf6bb74c375 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:42:52.683469 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-63a07aac-2bea-444e-b3ad-d8e51ad2d0e3 req-36e41cb7-e31d-45a0-923a-7bf6bb74c375 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:42:52.694211 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-63a07aac-2bea-444e-b3ad-d8e51ad2d0e3 req-36e41cb7-e31d-45a0-923a-7bf6bb74c375 service nova] Creating event network-changed:5942e31d-ecd1-4f97-9d8e-c38cb2323490 for instance ae780970-4212-46bc-8038-69067eb4e039 on hv-cinder-83769 May 16 17:42:52.699208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-63a07aac-2bea-444e-b3ad-d8e51ad2d0e3 req-36e41cb7-e31d-45a0-923a-7bf6bb74c375 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028629 May 16 17:42:52.699760 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 210/400] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:09.381684 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-894ab5e6-f025-4764-af00-6a3abf0d4090 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1265715255", "imageRef": "782bd628-ef1b-419c-99f5-2c312d1766a6", "flavorRef": "452", "networks": [{"uuid": "9f93a893-0813-4415-8e02-fac7fa54db24"}]}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:43:09.473389 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.network.neutron [None req-894ab5e6-f025-4764-af00-6a3abf0d4090 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] validate_networks() for [('9f93a893-0813-4415-8e02-fac7fa54db24', None, None, None, None, None)] {{(pid=128816) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:43:10.280475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-894ab5e6-f025-4764-af00-6a3abf0d4090 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Flavor limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:43:10.281166 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-894ab5e6-f025-4764-af00-6a3abf0d4090 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Image limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:43:10.281953 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-894ab5e6-f025-4764-af00-6a3abf0d4090 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Flavor pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:43:10.282418 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-894ab5e6-f025-4764-af00-6a3abf0d4090 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Image pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:43:10.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-894ab5e6-f025-4764-af00-6a3abf0d4090 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:43:10.292064 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-894ab5e6-f025-4764-af00-6a3abf0d4090 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:10.292516 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-894ab5e6-f025-4764-af00-6a3abf0d4090 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:10.293725 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-894ab5e6-f025-4764-af00-6a3abf0d4090 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:10.294347 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-894ab5e6-f025-4764-af00-6a3abf0d4090 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:10.314526 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-894ab5e6-f025-4764-af00-6a3abf0d4090 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Getting quotas for project 8e740d27d929404fbc7a4964dab899d0. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:43:10.320683 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-894ab5e6-f025-4764-af00-6a3abf0d4090 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Getting quotas for user ad9e1d2049fa4330b1f78692e9ab7b10 and project 8e740d27d929404fbc7a4964dab899d0. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:43:10.333226 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-894ab5e6-f025-4764-af00-6a3abf0d4090 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Going to run 1 instances... {{(pid=128816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:43:10.335638 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-894ab5e6-f025-4764-af00-6a3abf0d4090 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='782bd628-ef1b-419c-99f5-2c312d1766a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:43:10.393269 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-894ab5e6-f025-4764-af00-6a3abf0d4090 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.015664 May 16 17:43:10.393952 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 191/401] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:43:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:43:10.405623 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-9ab4ad7a-68c5-4091-8970-88b3d5e10069 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:10.407360 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-9ab4ad7a-68c5-4091-8970-88b3d5e10069 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:10.760627 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-9ab4ad7a-68c5-4091-8970-88b3d5e10069 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:10.772789 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-9ab4ad7a-68c5-4091-8970-88b3d5e10069 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6" status: 200 len: 1219 microversion: 2.1 time: 0.371861 May 16 17:43:10.785780 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 211/402] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:10 2022] GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 => generated 1219 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:43:11.794097 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-8c84b0ee-f113-4216-98d4-b9d0d8d8104f tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:11.795377 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-8c84b0ee-f113-4216-98d4-b9d0d8d8104f tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:11.807318 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8c84b0ee-f113-4216-98d4-b9d0d8d8104f tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:11.808011 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8c84b0ee-f113-4216-98d4-b9d0d8d8104f tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:11.808806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8c84b0ee-f113-4216-98d4-b9d0d8d8104f tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:11.810143 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8c84b0ee-f113-4216-98d4-b9d0d8d8104f tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:11.921284 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-8c84b0ee-f113-4216-98d4-b9d0d8d8104f tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:11.931581 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-8c84b0ee-f113-4216-98d4-b9d0d8d8104f tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6" status: 200 len: 1279 microversion: 2.1 time: 0.143100 May 16 17:43:11.938312 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 192/403] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:11 2022] GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 => generated 1279 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:12.955100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-39af2df2-94b6-4928-b93e-5eb2d2472c7d tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:12.956676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-39af2df2-94b6-4928-b93e-5eb2d2472c7d tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:12.977358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-39af2df2-94b6-4928-b93e-5eb2d2472c7d tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:12.978354 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-39af2df2-94b6-4928-b93e-5eb2d2472c7d tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:12.979329 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-39af2df2-94b6-4928-b93e-5eb2d2472c7d tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:12.979931 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-39af2df2-94b6-4928-b93e-5eb2d2472c7d tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:13.251309 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-39af2df2-94b6-4928-b93e-5eb2d2472c7d tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:13.260503 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-39af2df2-94b6-4928-b93e-5eb2d2472c7d tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6" status: 200 len: 1319 microversion: 2.1 time: 0.309542 May 16 17:43:13.271472 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 212/404] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:12 2022] GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:13.546140 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-8fe58b60-7696-4452-95a1-1e24a30800c6 req-815eed0c-c256-4c6b-89c4-34436b87c254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2c4e36-c99c-4e7e-8d51-3c718392f0a6", "tag": "5a11f1e6-ee0e-4119-a8ac-18053bc731e5"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:43:13.580003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-8fe58b60-7696-4452-95a1-1e24a30800c6 req-815eed0c-c256-4c6b-89c4-34436b87c254 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:13.581967 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-8fe58b60-7696-4452-95a1-1e24a30800c6 req-815eed0c-c256-4c6b-89c4-34436b87c254 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:13.626031 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-8fe58b60-7696-4452-95a1-1e24a30800c6 req-815eed0c-c256-4c6b-89c4-34436b87c254 service nova] Creating event network-changed:5a11f1e6-ee0e-4119-a8ac-18053bc731e5 for instance 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 on hv-cinder-83769 May 16 17:43:13.638095 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-8fe58b60-7696-4452-95a1-1e24a30800c6 req-815eed0c-c256-4c6b-89c4-34436b87c254 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093437 May 16 17:43:13.639334 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 193/405] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:43:14.278473 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-674c4f20-fa46-41cd-bb0e-c9550a1faf55 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:14.279744 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-674c4f20-fa46-41cd-bb0e-c9550a1faf55 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:14.293685 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-674c4f20-fa46-41cd-bb0e-c9550a1faf55 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:14.294497 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-674c4f20-fa46-41cd-bb0e-c9550a1faf55 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:14.295554 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-674c4f20-fa46-41cd-bb0e-c9550a1faf55 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:14.296137 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-674c4f20-fa46-41cd-bb0e-c9550a1faf55 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:14.506917 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-674c4f20-fa46-41cd-bb0e-c9550a1faf55 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:14.514571 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-674c4f20-fa46-41cd-bb0e-c9550a1faf55 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6" status: 200 len: 1319 microversion: 2.1 time: 0.240592 May 16 17:43:14.524319 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 213/406] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:14 2022] GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:15.534843 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a72da805-f85c-41a1-b1ef-f347dc789783 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:15.536356 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a72da805-f85c-41a1-b1ef-f347dc789783 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:15.542852 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a72da805-f85c-41a1-b1ef-f347dc789783 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:15.543940 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a72da805-f85c-41a1-b1ef-f347dc789783 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:15.544781 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a72da805-f85c-41a1-b1ef-f347dc789783 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:15.545298 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a72da805-f85c-41a1-b1ef-f347dc789783 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:15.766689 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-a72da805-f85c-41a1-b1ef-f347dc789783 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:15.775405 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a72da805-f85c-41a1-b1ef-f347dc789783 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6" status: 200 len: 1319 microversion: 2.1 time: 0.247111 May 16 17:43:15.778889 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 194/407] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:15 2022] GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:16.795479 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-92f3d99d-e6db-43c6-8dbd-22ba2db940b0 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:16.796187 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-92f3d99d-e6db-43c6-8dbd-22ba2db940b0 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:16.803619 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-92f3d99d-e6db-43c6-8dbd-22ba2db940b0 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:16.804425 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-92f3d99d-e6db-43c6-8dbd-22ba2db940b0 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:16.805430 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-92f3d99d-e6db-43c6-8dbd-22ba2db940b0 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:16.806096 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-92f3d99d-e6db-43c6-8dbd-22ba2db940b0 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:16.949559 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-92f3d99d-e6db-43c6-8dbd-22ba2db940b0 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:16.959457 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-92f3d99d-e6db-43c6-8dbd-22ba2db940b0 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6" status: 200 len: 1319 microversion: 2.1 time: 0.168155 May 16 17:43:16.960047 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 214/408] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:16 2022] GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:16.992321 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ffe8cb7c-7166-47ee-b7f5-1aa9b7d85676 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:16.993577 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-ffe8cb7c-7166-47ee-b7f5-1aa9b7d85676 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:17.000216 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ffe8cb7c-7166-47ee-b7f5-1aa9b7d85676 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:17.000660 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ffe8cb7c-7166-47ee-b7f5-1aa9b7d85676 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:17.001424 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ffe8cb7c-7166-47ee-b7f5-1aa9b7d85676 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:17.001893 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ffe8cb7c-7166-47ee-b7f5-1aa9b7d85676 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:17.025093 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ffe8cb7c-7166-47ee-b7f5-1aa9b7d85676 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada/ips" status: 200 len: 149 microversion: 2.1 time: 0.036547 May 16 17:43:17.025679 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 195/409] 10.222.0.58 () {58 vars in 1247 bytes} [Mon May 16 17:43:16 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:17.036848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-170be092-a347-44d7-a1f6-022f37a92488 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7eaa2d30-bc5a-41d4-81d3-ce9536e713cb"}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:43:17.038194 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-170be092-a347-44d7-a1f6-022f37a92488 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:17.045130 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-170be092-a347-44d7-a1f6-022f37a92488 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:17.045835 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-170be092-a347-44d7-a1f6-022f37a92488 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:17.046805 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-170be092-a347-44d7-a1f6-022f37a92488 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:17.047234 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-170be092-a347-44d7-a1f6-022f37a92488 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:17.127515 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-170be092-a347-44d7-a1f6-022f37a92488 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] HTTP exception thrown: Invalid volume: volume 7eaa2d30-bc5a-41d4-81d3-ce9536e713cb is already attached to instances: 79ea3f0a-7300-45ed-8778-4ca04699ff84 May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-170be092-a347-44d7-a1f6-022f37a92488 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Request method failure captured: May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: POST /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada/os-volume_attachments HTTP/1.1 May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 74 May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigox4BWkjUGbMIvOn7lTkLppnWsYzIVQtNJHubTanufmvEHsiu_ONp3auIJGxAXU0K5GHn7jQDnT6YubbdzHrAJT45fAGoePZ3wwIuaMH8qkH2BLOah56kKB6Od9VwHk7uC0dRignIhl6Vtrx_s0xElsY95RDLsFnhdltcQlhJ0yFrss May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 80c60c24806542e889c070d519172e79 May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:43:17.129420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:43:17.131027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80c60c24806542e889c070d519172e79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80c60c24806542e889c070d519172e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:43:17.131027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:43:17.131027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 80c60c24806542e889c070d519172e79 May 16 17:43:17.131027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:43:17.131027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:43:17.131027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:43:17.131027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:43:17.131027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: 6838738598ce4d2186e7c0b6547868f6 May 16 17:43:17.131027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:43:17.131027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: May 16 17:43:17.131027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {"volumeAttachment": {"volumeId": "7eaa2d30-bc5a-41d4-81d3-ce9536e713cb"}} May 16 17:43:17.131027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Invalid volume: volume 7eaa2d30-bc5a-41d4-81d3-ce9536e713cb is already attached to instances: 79ea3f0a-7300-45ed-8778-4ca04699ff84 May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'server_id': 'cc187581-b958-457b-8aca-7774e8416ada', 'body': {'volumeAttachment': {'volumeId': '7eaa2d30-bc5a-41d4-81d3-ce9536e713cb'}}} May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7eaa2d30-bc5a-41d4-81d3-ce9536e713cb is already attached to instances: 79ea3f0a-7300-45ed-8778-4ca04699ff84 May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:43:17.131937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7eaa2d30-bc5a-41d4-81d3-ce9536e713cb is already attached to instances: 79ea3f0a-7300-45ed-8778-4ca04699ff84 May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:43:17.133379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:43:17.135884 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:43:17.135884 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:43:17.135884 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:43:17.135884 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7eaa2d30-bc5a-41d4-81d3-ce9536e713cb is already attached to instances: 79ea3f0a-7300-45ed-8778-4ca04699ff84 May 16 17:43:17.135884 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:43:17.137070 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-170be092-a347-44d7-a1f6-022f37a92488 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Returning 400 to user: Invalid volume: volume 7eaa2d30-bc5a-41d4-81d3-ce9536e713cb is already attached to instances: 79ea3f0a-7300-45ed-8778-4ca04699ff84 {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:43:17.137961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-170be092-a347-44d7-a1f6-022f37a92488 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "POST /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105521 May 16 17:43:17.138868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 215/410] 10.222.0.58 () {60 vars in 1322 bytes} [Mon May 16 17:43:17 2022] POST /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 16 17:43:17.151759 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a34480bd-e235-41fb-a4b8-26f641a04846 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:17.152252 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a34480bd-e235-41fb-a4b8-26f641a04846 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:17.158985 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a34480bd-e235-41fb-a4b8-26f641a04846 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:17.159456 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a34480bd-e235-41fb-a4b8-26f641a04846 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:17.160224 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a34480bd-e235-41fb-a4b8-26f641a04846 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:17.160646 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a34480bd-e235-41fb-a4b8-26f641a04846 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:17.187631 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a34480bd-e235-41fb-a4b8-26f641a04846 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Going to try to terminate instance {{(pid=128816) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:43:17.294617 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a34480bd-e235-41fb-a4b8-26f641a04846 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 204 len: 0 microversion: 2.1 time: 0.146470 May 16 17:43:17.295608 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 196/411] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:43:17 2022] DELETE /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:43:17.304040 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-934a6b73-2f57-46e0-b479-f54f2f2598e5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:17.304573 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-934a6b73-2f57-46e0-b479-f54f2f2598e5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:17.312006 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-934a6b73-2f57-46e0-b479-f54f2f2598e5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:17.312818 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-934a6b73-2f57-46e0-b479-f54f2f2598e5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:17.313824 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-934a6b73-2f57-46e0-b479-f54f2f2598e5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:17.314447 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-934a6b73-2f57-46e0-b479-f54f2f2598e5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:17.454703 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-934a6b73-2f57-46e0-b479-f54f2f2598e5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:17.462883 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-934a6b73-2f57-46e0-b479-f54f2f2598e5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1680 microversion: 2.1 time: 0.162947 May 16 17:43:17.463665 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 216/412] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:17 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:17.978242 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-01af2d17-bd43-4c57-99be-8dcb65fc57e7 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:17.979580 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-01af2d17-bd43-4c57-99be-8dcb65fc57e7 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:17.986768 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-01af2d17-bd43-4c57-99be-8dcb65fc57e7 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:17.987343 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-01af2d17-bd43-4c57-99be-8dcb65fc57e7 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:17.988658 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-01af2d17-bd43-4c57-99be-8dcb65fc57e7 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:17.991812 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-01af2d17-bd43-4c57-99be-8dcb65fc57e7 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:18.149240 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-01af2d17-bd43-4c57-99be-8dcb65fc57e7 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:18.157635 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-01af2d17-bd43-4c57-99be-8dcb65fc57e7 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6" status: 200 len: 1319 microversion: 2.1 time: 0.184881 May 16 17:43:18.158114 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 197/413] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:17 2022] GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:18.481946 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-90836a66-e8e2-481a-806e-76cd25b8d5ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:18.483203 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-90836a66-e8e2-481a-806e-76cd25b8d5ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:18.490236 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-90836a66-e8e2-481a-806e-76cd25b8d5ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:18.490686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-90836a66-e8e2-481a-806e-76cd25b8d5ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:18.491457 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-90836a66-e8e2-481a-806e-76cd25b8d5ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:18.492592 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-90836a66-e8e2-481a-806e-76cd25b8d5ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:18.627135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-90836a66-e8e2-481a-806e-76cd25b8d5ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:18.634845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-90836a66-e8e2-481a-806e-76cd25b8d5ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1680 microversion: 2.1 time: 0.156957 May 16 17:43:18.635706 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 217/414] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:18 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:19.174540 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4f5dc3d5-5e44-45f8-90fb-ba5c4bba7cea tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:19.175241 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4f5dc3d5-5e44-45f8-90fb-ba5c4bba7cea tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:19.181654 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4f5dc3d5-5e44-45f8-90fb-ba5c4bba7cea tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:19.182300 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4f5dc3d5-5e44-45f8-90fb-ba5c4bba7cea tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:19.185603 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4f5dc3d5-5e44-45f8-90fb-ba5c4bba7cea tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:19.186233 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4f5dc3d5-5e44-45f8-90fb-ba5c4bba7cea tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:19.420060 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-4f5dc3d5-5e44-45f8-90fb-ba5c4bba7cea tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:19.431505 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4f5dc3d5-5e44-45f8-90fb-ba5c4bba7cea tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6" status: 200 len: 1319 microversion: 2.1 time: 0.258941 May 16 17:43:19.432297 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 198/415] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:19 2022] GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:19.652489 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-38d26eb9-af26-41a5-8e9a-936f68f312c1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:19.653047 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-38d26eb9-af26-41a5-8e9a-936f68f312c1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:19.659835 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-38d26eb9-af26-41a5-8e9a-936f68f312c1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:19.660285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-38d26eb9-af26-41a5-8e9a-936f68f312c1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:19.661076 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-38d26eb9-af26-41a5-8e9a-936f68f312c1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:19.661520 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-38d26eb9-af26-41a5-8e9a-936f68f312c1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:19.744622 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-38d26eb9-af26-41a5-8e9a-936f68f312c1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:19.755347 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-38d26eb9-af26-41a5-8e9a-936f68f312c1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1613 microversion: 2.1 time: 0.106789 May 16 17:43:19.759085 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 218/416] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:19 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1613 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:20.026245 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-88a6ee44-ec3e-4e27-9e2d-d78add816b88 req-0f65ed91-8f64-4223-8b16-77a0d38c5ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2c4e36-c99c-4e7e-8d51-3c718392f0a6", "name": "network-vif-plugged", "status": "completed", "tag": "5a11f1e6-ee0e-4119-a8ac-18053bc731e5"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:43:20.039289 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-88a6ee44-ec3e-4e27-9e2d-d78add816b88 req-0f65ed91-8f64-4223-8b16-77a0d38c5ac2 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:20.039882 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-88a6ee44-ec3e-4e27-9e2d-d78add816b88 req-0f65ed91-8f64-4223-8b16-77a0d38c5ac2 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:20.063202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-88a6ee44-ec3e-4e27-9e2d-d78add816b88 req-0f65ed91-8f64-4223-8b16-77a0d38c5ac2 service nova] Creating event network-vif-plugged:5a11f1e6-ee0e-4119-a8ac-18053bc731e5 for instance 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 on hv-cinder-83769 May 16 17:43:20.078575 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-88a6ee44-ec3e-4e27-9e2d-d78add816b88 req-0f65ed91-8f64-4223-8b16-77a0d38c5ac2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047980 May 16 17:43:20.079379 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 199/417] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 16 17:43:20.399511 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-471300f6-fa99-4137-8664-11f282f33731 req-e2fb518c-30ff-4b5e-9d3d-7c30763942ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc187581-b958-457b-8aca-7774e8416ada", "name": "network-vif-deleted", "tag": "f9e656f2-4ff2-469e-ba68-5ee1c1275d29"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:43:20.415488 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-471300f6-fa99-4137-8664-11f282f33731 req-e2fb518c-30ff-4b5e-9d3d-7c30763942ef service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:20.418726 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-471300f6-fa99-4137-8664-11f282f33731 req-e2fb518c-30ff-4b5e-9d3d-7c30763942ef service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:20.437470 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-471300f6-fa99-4137-8664-11f282f33731 req-e2fb518c-30ff-4b5e-9d3d-7c30763942ef service nova] Creating event network-vif-deleted:f9e656f2-4ff2-469e-ba68-5ee1c1275d29 for instance cc187581-b958-457b-8aca-7774e8416ada on hv-cinder-83769 May 16 17:43:20.449383 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ed99db1a-2caf-466f-b077-0e89bd85edeb tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:20.451612 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-ed99db1a-2caf-466f-b077-0e89bd85edeb tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:20.460162 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-471300f6-fa99-4137-8664-11f282f33731 req-e2fb518c-30ff-4b5e-9d3d-7c30763942ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059927 May 16 17:43:20.463096 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 219/418] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:20.464125 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ed99db1a-2caf-466f-b077-0e89bd85edeb tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:20.464940 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ed99db1a-2caf-466f-b077-0e89bd85edeb tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:20.466097 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ed99db1a-2caf-466f-b077-0e89bd85edeb tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:20.466721 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ed99db1a-2caf-466f-b077-0e89bd85edeb tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:20.694695 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-ed99db1a-2caf-466f-b077-0e89bd85edeb tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:20.705866 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ed99db1a-2caf-466f-b077-0e89bd85edeb tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6" status: 200 len: 1319 microversion: 2.1 time: 0.260711 May 16 17:43:20.707370 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 200/419] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:20 2022] GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:20.776411 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-50d3996f-bd9d-43a0-b658-2a6fb8610985 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:20.777580 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-50d3996f-bd9d-43a0-b658-2a6fb8610985 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:20.788433 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-50d3996f-bd9d-43a0-b658-2a6fb8610985 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:20.789009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-50d3996f-bd9d-43a0-b658-2a6fb8610985 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:20.790070 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-50d3996f-bd9d-43a0-b658-2a6fb8610985 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:20.790841 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-50d3996f-bd9d-43a0-b658-2a6fb8610985 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:20.824543 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-50d3996f-bd9d-43a0-b658-2a6fb8610985 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:20.825182 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-50d3996f-bd9d-43a0-b658-2a6fb8610985 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:20.825767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.objects.instance [None req-50d3996f-bd9d-43a0-b658-2a6fb8610985 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lazy-loading 'fault' on Instance uuid cc187581-b958-457b-8aca-7774e8416ada {{(pid=128815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:43:20.883318 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-50d3996f-bd9d-43a0-b658-2a6fb8610985 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:20.891466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-50d3996f-bd9d-43a0-b658-2a6fb8610985 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 200 len: 1331 microversion: 2.1 time: 0.119196 May 16 17:43:20.892028 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 220/420] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:20 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 1331 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:21.217880 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-8fad72f8-7365-40b9-b9c5-6b62f67cf681 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Action: 'create', calling method: .version_select at 0x7f79a4cdc550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-70943443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL61wiGsd+d2g35HOtRu0LaO8ubjEEpO+89r9SR6/35GsVeCJG/CtSDucewLHxQiBZRLvOVYC0f+vgMtJR0Skl9Py4p44O0zMalc9efyq++8+3m6T15Z3oOWy7uSVCnBwg=="}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:43:21.233255 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-8fad72f8-7365-40b9-b9c5-6b62f67cf681 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Getting quotas for project 2a1f3dc604cd46e4961489cd14f66d13. Resources: {'key_pairs'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:43:21.237793 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-8fad72f8-7365-40b9-b9c5-6b62f67cf681 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Getting quotas for user fea27ed178c8437697a23591a2163768 and project 2a1f3dc604cd46e4961489cd14f66d13. Resources: {'key_pairs'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:43:21.263076 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-8fad72f8-7365-40b9-b9c5-6b62f67cf681 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.049246 May 16 17:43:21.263989 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 201/421] 10.222.0.58 () {60 vars in 1158 bytes} [Mon May 16 17:43:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:21.315391 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-addacf47-185d-4c8d-9570-7f66b17baddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1646708652", "imageRef": "bd8c613d-44bf-411b-9a76-741da00491a6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-70943443", "networks": [{"uuid": "ded888d4-a06e-43ec-993f-7e4a7d4b7b51"}]}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:43:21.371952 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.network.neutron [None req-addacf47-185d-4c8d-9570-7f66b17baddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] validate_networks() for [('ded888d4-a06e-43ec-993f-7e4a7d4b7b51', None, None, None, None, None)] {{(pid=128815) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:43:21.723649 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-2ddfba29-2ba8-4a97-ae1d-b43edad0c3de tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:21.724377 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-2ddfba29-2ba8-4a97-ae1d-b43edad0c3de tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:21.731078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2ddfba29-2ba8-4a97-ae1d-b43edad0c3de tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:21.731509 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2ddfba29-2ba8-4a97-ae1d-b43edad0c3de tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:21.732491 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2ddfba29-2ba8-4a97-ae1d-b43edad0c3de tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:21.732927 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2ddfba29-2ba8-4a97-ae1d-b43edad0c3de tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:21.758883 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-addacf47-185d-4c8d-9570-7f66b17baddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Flavor limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:43:21.759307 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-addacf47-185d-4c8d-9570-7f66b17baddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Image limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:43:21.759776 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-addacf47-185d-4c8d-9570-7f66b17baddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Flavor pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:43:21.760179 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-addacf47-185d-4c8d-9570-7f66b17baddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Image pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:43:21.760585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-addacf47-185d-4c8d-9570-7f66b17baddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:43:21.772280 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-addacf47-185d-4c8d-9570-7f66b17baddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:21.772863 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-addacf47-185d-4c8d-9570-7f66b17baddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:21.773830 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-addacf47-185d-4c8d-9570-7f66b17baddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:21.774320 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-addacf47-185d-4c8d-9570-7f66b17baddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:21.791199 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-addacf47-185d-4c8d-9570-7f66b17baddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Getting quotas for project 2a1f3dc604cd46e4961489cd14f66d13. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:43:21.795603 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-addacf47-185d-4c8d-9570-7f66b17baddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Getting quotas for user fea27ed178c8437697a23591a2163768 and project 2a1f3dc604cd46e4961489cd14f66d13. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:43:21.807158 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-addacf47-185d-4c8d-9570-7f66b17baddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Going to run 1 instances... {{(pid=128815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:43:21.808598 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-addacf47-185d-4c8d-9570-7f66b17baddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd8c613d-44bf-411b-9a76-741da00491a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:43:21.855904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-addacf47-185d-4c8d-9570-7f66b17baddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546465 May 16 17:43:21.861879 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 221/422] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:43:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:43:21.866237 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-b242c7c4-8382-4e91-b386-08fc340a81e8 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:21.867084 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b242c7c4-8382-4e91-b386-08fc340a81e8 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:21.873103 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-2ddfba29-2ba8-4a97-ae1d-b43edad0c3de tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:21.887134 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-2ddfba29-2ba8-4a97-ae1d-b43edad0c3de tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6" status: 200 len: 1319 microversion: 2.1 time: 0.167374 May 16 17:43:21.888051 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 202/423] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:21 2022] GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:21.909111 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9ef89df6-6561-40b5-813f-e7c90f60b872 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:21.909908 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-9ef89df6-6561-40b5-813f-e7c90f60b872 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:21.916952 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9ef89df6-6561-40b5-813f-e7c90f60b872 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:21.917700 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9ef89df6-6561-40b5-813f-e7c90f60b872 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:21.918872 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9ef89df6-6561-40b5-813f-e7c90f60b872 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:21.919377 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9ef89df6-6561-40b5-813f-e7c90f60b872 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:21.934855 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b242c7c4-8382-4e91-b386-08fc340a81e8 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:21.938312 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-9ef89df6-6561-40b5-813f-e7c90f60b872 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] HTTP exception thrown: Instance cc187581-b958-457b-8aca-7774e8416ada could not be found. May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9ef89df6-6561-40b5-813f-e7c90f60b872 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Request method failure captured: May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada HTTP/1.1 May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigox4BWkjUGbMIvOn7lTkLppnWsYzIVQtNJHubTanufmvEHsiu_ONp3auIJGxAXU0K5GHn7jQDnT6YubbdzHrAJT45fAGoePZ3wwIuaMH8qkH2BLOah56kKB6Od9VwHk7uC0dRignIhl6Vtrx_s0xElsY95RDLsFnhdltcQlhJ0yFrss May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 80c60c24806542e889c070d519172e79 May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:43:21.940078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:43:21.941378 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80c60c24806542e889c070d519172e79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80c60c24806542e889c070d519172e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:43:21.941378 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:43:21.941378 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 80c60c24806542e889c070d519172e79 May 16 17:43:21.941378 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:43:21.941378 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:43:21.941378 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:43:21.941378 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:43:21.941378 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 6838738598ce4d2186e7c0b6547868f6 May 16 17:43:21.941378 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:43:21.941378 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:43:21.941378 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance cc187581-b958-457b-8aca-7774e8416ada could not be found. May 16 17:43:21.941378 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': 'cc187581-b958-457b-8aca-7774e8416ada'} May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc187581-b958-457b-8aca-7774e8416ada could not be found. May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:43:21.942163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:43:21.943579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:43:21.943579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:43:21.943579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:43:21.943579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:43:21.943579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:43:21.943579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:43:21.943579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:43:21.943579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc187581-b958-457b-8aca-7774e8416ada could not be found. May 16 17:43:21.943579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:43:21.943579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:43:21.943579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:43:21.943579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:43:21.943579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:43:21.943579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:43:21.943579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:43:21.943579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:43:21.943579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc187581-b958-457b-8aca-7774e8416ada could not be found. May 16 17:43:21.943579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:43:21.944654 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9ef89df6-6561-40b5-813f-e7c90f60b872 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Returning 404 to user: Instance cc187581-b958-457b-8aca-7774e8416ada could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:43:21.944654 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-9ef89df6-6561-40b5-813f-e7c90f60b872 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 404 len: 111 microversion: 2.1 time: 0.037341 May 16 17:43:21.946329 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 203/424] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:21 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 17:43:21.949273 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-b242c7c4-8382-4e91-b386-08fc340a81e8 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1257 microversion: 2.1 time: 0.086700 May 16 17:43:21.959097 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-167748f8-3f7c-4fae-a773-9e1059465d9f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '.version_select at 0x7f79a4be69d0>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:21.961199 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 222/425] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:21 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1257 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:21.975163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-167748f8-3f7c-4fae-a773-9e1059465d9f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136987100" status: 202 len: 0 microversion: 2.1 time: 0.027749 May 16 17:43:21.975901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 204/426] 10.222.0.58 () {58 vars in 1220 bytes} [Mon May 16 17:43:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136987100 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:43:22.714130 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-305a2987-6bc1-43c6-9043-99ca61b47d2d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:22.714705 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-305a2987-6bc1-43c6-9043-99ca61b47d2d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:22.721287 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-305a2987-6bc1-43c6-9043-99ca61b47d2d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:22.721848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-305a2987-6bc1-43c6-9043-99ca61b47d2d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:22.723016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-305a2987-6bc1-43c6-9043-99ca61b47d2d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:22.723518 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-305a2987-6bc1-43c6-9043-99ca61b47d2d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:22.848682 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.objects.instance [None req-305a2987-6bc1-43c6-9043-99ca61b47d2d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lazy-loading 'services' on Instance uuid 79ea3f0a-7300-45ed-8778-4ca04699ff84 {{(pid=128815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:43:22.906400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ebdda57e-96e5-4ab0-832d-eba119681496 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:22.907819 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-ebdda57e-96e5-4ab0-832d-eba119681496 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:22.918149 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ebdda57e-96e5-4ab0-832d-eba119681496 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:22.918789 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ebdda57e-96e5-4ab0-832d-eba119681496 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:22.919735 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ebdda57e-96e5-4ab0-832d-eba119681496 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:22.920488 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ebdda57e-96e5-4ab0-832d-eba119681496 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:22.976965 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-305a2987-6bc1-43c6-9043-99ca61b47d2d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "DELETE /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments/7eaa2d30-bc5a-41d4-81d3-ce9536e713cb" status: 202 len: 0 microversion: 2.1 time: 0.266685 May 16 17:43:22.977854 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 223/427] 10.222.0.58 () {58 vars in 1415 bytes} [Mon May 16 17:43:22 2022] DELETE /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments/7eaa2d30-bc5a-41d4-81d3-ce9536e713cb => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:43:22.983613 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ec774bde-a565-4ab1-8f83-31b77d110938 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:22.984397 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ec774bde-a565-4ab1-8f83-31b77d110938 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:22.991558 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ec774bde-a565-4ab1-8f83-31b77d110938 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:22.992414 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ec774bde-a565-4ab1-8f83-31b77d110938 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:22.993699 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ec774bde-a565-4ab1-8f83-31b77d110938 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:22.994341 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ec774bde-a565-4ab1-8f83-31b77d110938 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:23.108007 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ec774bde-a565-4ab1-8f83-31b77d110938 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:23.116965 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ec774bde-a565-4ab1-8f83-31b77d110938 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1317 microversion: 2.1 time: 0.137779 May 16 17:43:23.117650 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 224/428] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:22 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:23.122727 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-cd8303fa-e9ab-4854-924d-03c8f1b1b3d0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:23.124310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-cd8303fa-e9ab-4854-924d-03c8f1b1b3d0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:23.130451 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cd8303fa-e9ab-4854-924d-03c8f1b1b3d0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:23.130900 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cd8303fa-e9ab-4854-924d-03c8f1b1b3d0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:23.131667 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cd8303fa-e9ab-4854-924d-03c8f1b1b3d0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:23.132085 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cd8303fa-e9ab-4854-924d-03c8f1b1b3d0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:23.161743 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-cd8303fa-e9ab-4854-924d-03c8f1b1b3d0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042670 May 16 17:43:23.162230 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 225/429] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:43:23 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:23.173475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-ebdda57e-96e5-4ab0-832d-eba119681496 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:23.180825 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ebdda57e-96e5-4ab0-832d-eba119681496 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6" status: 200 len: 1507 microversion: 2.1 time: 0.280426 May 16 17:43:23.181375 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 205/430] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:22 2022] GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 => generated 1507 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:24.139123 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4cf275d3-463f-4414-a892-3eb6fe99fd30 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:24.140017 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-4cf275d3-463f-4414-a892-3eb6fe99fd30 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:24.148112 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4cf275d3-463f-4414-a892-3eb6fe99fd30 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:24.148587 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4cf275d3-463f-4414-a892-3eb6fe99fd30 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:24.149352 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4cf275d3-463f-4414-a892-3eb6fe99fd30 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:24.149812 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4cf275d3-463f-4414-a892-3eb6fe99fd30 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:24.173691 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-6d703ea5-42ef-40d7-9275-940e13dc13ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:24.174622 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-6d703ea5-42ef-40d7-9275-940e13dc13ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:24.180883 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6d703ea5-42ef-40d7-9275-940e13dc13ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:24.181328 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6d703ea5-42ef-40d7-9275-940e13dc13ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:24.182184 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6d703ea5-42ef-40d7-9275-940e13dc13ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:24.182626 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6d703ea5-42ef-40d7-9275-940e13dc13ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:24.218076 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-6d703ea5-42ef-40d7-9275-940e13dc13ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048365 May 16 17:43:24.218659 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 206/431] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:43:24 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:24.219721 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-4cf275d3-463f-4414-a892-3eb6fe99fd30 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:24.227808 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-4cf275d3-463f-4414-a892-3eb6fe99fd30 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1315 microversion: 2.1 time: 0.095693 May 16 17:43:24.228405 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 226/432] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:24 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1315 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:25.230215 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-355858e0-fec6-4a5c-8a4c-a12a3e9b7a24 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:25.231299 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-355858e0-fec6-4a5c-8a4c-a12a3e9b7a24 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:25.237920 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-355858e0-fec6-4a5c-8a4c-a12a3e9b7a24 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:25.238400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-355858e0-fec6-4a5c-8a4c-a12a3e9b7a24 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:25.239179 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-355858e0-fec6-4a5c-8a4c-a12a3e9b7a24 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:25.239608 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-355858e0-fec6-4a5c-8a4c-a12a3e9b7a24 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:25.244250 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-dccf1eb8-45a6-40c5-ac59-b36d9dae7069 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:25.244849 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-dccf1eb8-45a6-40c5-ac59-b36d9dae7069 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:25.251324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dccf1eb8-45a6-40c5-ac59-b36d9dae7069 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:25.251770 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dccf1eb8-45a6-40c5-ac59-b36d9dae7069 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:25.252524 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dccf1eb8-45a6-40c5-ac59-b36d9dae7069 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:25.252948 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dccf1eb8-45a6-40c5-ac59-b36d9dae7069 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:25.269525 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-355858e0-fec6-4a5c-8a4c-a12a3e9b7a24 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043381 May 16 17:43:25.270239 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 207/433] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:43:25 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:25.313333 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-dccf1eb8-45a6-40c5-ac59-b36d9dae7069 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:25.321074 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-dccf1eb8-45a6-40c5-ac59-b36d9dae7069 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1315 microversion: 2.1 time: 0.080652 May 16 17:43:25.321712 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 227/434] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:25 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1315 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:26.284919 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-bed0aa79-682c-494c-a724-c2fefaf64015 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:26.286684 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-bed0aa79-682c-494c-a724-c2fefaf64015 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:26.296876 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bed0aa79-682c-494c-a724-c2fefaf64015 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:26.297325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bed0aa79-682c-494c-a724-c2fefaf64015 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:26.298129 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bed0aa79-682c-494c-a724-c2fefaf64015 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:26.298560 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bed0aa79-682c-494c-a724-c2fefaf64015 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:26.328684 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-bed0aa79-682c-494c-a724-c2fefaf64015 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050409 May 16 17:43:26.329235 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 208/435] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:43:26 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:26.338056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-7f54ee59-b722-4b0a-a04a-83c4f76a6dd7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:26.338668 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-7f54ee59-b722-4b0a-a04a-83c4f76a6dd7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:26.345140 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7f54ee59-b722-4b0a-a04a-83c4f76a6dd7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:26.345579 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7f54ee59-b722-4b0a-a04a-83c4f76a6dd7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:26.346431 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7f54ee59-b722-4b0a-a04a-83c4f76a6dd7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:26.346778 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7f54ee59-b722-4b0a-a04a-83c4f76a6dd7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:26.411254 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-7f54ee59-b722-4b0a-a04a-83c4f76a6dd7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:26.418885 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-7f54ee59-b722-4b0a-a04a-83c4f76a6dd7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1315 microversion: 2.1 time: 0.084662 May 16 17:43:26.419430 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 228/436] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:26 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1315 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:27.344388 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-be969af2-f0a2-4f83-a882-c064101ae5bc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:27.345952 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-be969af2-f0a2-4f83-a882-c064101ae5bc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:27.356339 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-be969af2-f0a2-4f83-a882-c064101ae5bc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:27.357084 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-be969af2-f0a2-4f83-a882-c064101ae5bc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:27.358458 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-be969af2-f0a2-4f83-a882-c064101ae5bc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:27.358897 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-be969af2-f0a2-4f83-a882-c064101ae5bc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:27.387964 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-be969af2-f0a2-4f83-a882-c064101ae5bc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050588 May 16 17:43:27.388513 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 209/437] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:43:27 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:27.436549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-fe4e62d3-42b8-4055-a79a-0aa942cefbcf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:27.437145 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-fe4e62d3-42b8-4055-a79a-0aa942cefbcf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:27.443938 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fe4e62d3-42b8-4055-a79a-0aa942cefbcf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:27.444377 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fe4e62d3-42b8-4055-a79a-0aa942cefbcf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:27.445141 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fe4e62d3-42b8-4055-a79a-0aa942cefbcf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:27.445594 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fe4e62d3-42b8-4055-a79a-0aa942cefbcf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:27.508948 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-fe4e62d3-42b8-4055-a79a-0aa942cefbcf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:27.517831 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-fe4e62d3-42b8-4055-a79a-0aa942cefbcf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1315 microversion: 2.1 time: 0.085220 May 16 17:43:27.518398 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 229/438] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:27 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1315 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:28.402641 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-7afdca70-f40c-4a95-98c6-d330f16f286f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:28.403973 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-7afdca70-f40c-4a95-98c6-d330f16f286f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:28.410857 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7afdca70-f40c-4a95-98c6-d330f16f286f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:28.411301 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7afdca70-f40c-4a95-98c6-d330f16f286f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:28.412074 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7afdca70-f40c-4a95-98c6-d330f16f286f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:28.412509 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7afdca70-f40c-4a95-98c6-d330f16f286f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:28.448336 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-7afdca70-f40c-4a95-98c6-d330f16f286f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047681 May 16 17:43:28.449109 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 210/439] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:43:28 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:28.538061 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-570a8fc8-c9da-4d1e-98f2-d7cc000dc0e8 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:28.538670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-570a8fc8-c9da-4d1e-98f2-d7cc000dc0e8 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:28.545586 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-570a8fc8-c9da-4d1e-98f2-d7cc000dc0e8 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:28.546070 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-570a8fc8-c9da-4d1e-98f2-d7cc000dc0e8 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:28.546834 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-570a8fc8-c9da-4d1e-98f2-d7cc000dc0e8 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:28.547265 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-570a8fc8-c9da-4d1e-98f2-d7cc000dc0e8 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:28.631610 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-570a8fc8-c9da-4d1e-98f2-d7cc000dc0e8 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:28.644595 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-570a8fc8-c9da-4d1e-98f2-d7cc000dc0e8 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1315 microversion: 2.1 time: 0.109995 May 16 17:43:28.645455 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 230/440] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:28 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1315 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:43:29.460078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-fba9044b-d6df-46e5-bc23-a5ff0a2beedb tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:29.461111 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-fba9044b-d6df-46e5-bc23-a5ff0a2beedb tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:29.467526 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fba9044b-d6df-46e5-bc23-a5ff0a2beedb tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:29.468050 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fba9044b-d6df-46e5-bc23-a5ff0a2beedb tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:29.468931 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fba9044b-d6df-46e5-bc23-a5ff0a2beedb tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:29.469432 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fba9044b-d6df-46e5-bc23-a5ff0a2beedb tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:29.501061 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-fba9044b-d6df-46e5-bc23-a5ff0a2beedb tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044929 May 16 17:43:29.504921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 211/441] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:43:29 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:29.662228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-66002dd6-1853-4a87-b957-8c785037a848 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:29.662786 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-66002dd6-1853-4a87-b957-8c785037a848 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:29.669645 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-66002dd6-1853-4a87-b957-8c785037a848 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:29.670094 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-66002dd6-1853-4a87-b957-8c785037a848 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:29.670904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-66002dd6-1853-4a87-b957-8c785037a848 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:29.671335 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-66002dd6-1853-4a87-b957-8c785037a848 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:29.806191 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-66002dd6-1853-4a87-b957-8c785037a848 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:29.813822 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-66002dd6-1853-4a87-b957-8c785037a848 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1357 microversion: 2.1 time: 0.155604 May 16 17:43:29.814723 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 231/442] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:29 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:30.512857 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-77a4e125-222c-499a-96d2-982bc8d69573 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:30.514063 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-77a4e125-222c-499a-96d2-982bc8d69573 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:30.520515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-77a4e125-222c-499a-96d2-982bc8d69573 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:30.521053 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-77a4e125-222c-499a-96d2-982bc8d69573 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:30.521938 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-77a4e125-222c-499a-96d2-982bc8d69573 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:30.522438 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-77a4e125-222c-499a-96d2-982bc8d69573 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:30.554197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-77a4e125-222c-499a-96d2-982bc8d69573 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045402 May 16 17:43:30.554874 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 212/443] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:43:30 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:30.832113 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-416b9a98-9c4e-484d-bf53-eb093ea33ddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:30.832974 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-416b9a98-9c4e-484d-bf53-eb093ea33ddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:30.839118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-416b9a98-9c4e-484d-bf53-eb093ea33ddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:30.839575 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-416b9a98-9c4e-484d-bf53-eb093ea33ddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:30.840326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-416b9a98-9c4e-484d-bf53-eb093ea33ddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:30.840750 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-416b9a98-9c4e-484d-bf53-eb093ea33ddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:30.978797 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-416b9a98-9c4e-484d-bf53-eb093ea33ddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:30.987514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-416b9a98-9c4e-484d-bf53-eb093ea33ddf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1357 microversion: 2.1 time: 0.159947 May 16 17:43:30.988271 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 232/444] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:30 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:31.566309 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b43accba-90ca-4d2e-bce1-85f9250c2b42 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:31.567684 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b43accba-90ca-4d2e-bce1-85f9250c2b42 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:31.574710 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b43accba-90ca-4d2e-bce1-85f9250c2b42 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:31.575335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b43accba-90ca-4d2e-bce1-85f9250c2b42 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:31.576353 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b43accba-90ca-4d2e-bce1-85f9250c2b42 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:31.577096 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b43accba-90ca-4d2e-bce1-85f9250c2b42 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:31.609025 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b43accba-90ca-4d2e-bce1-85f9250c2b42 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046882 May 16 17:43:31.609708 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 213/445] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:43:31 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:32.006425 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-1f6d30f7-f83f-4b92-b0ad-e57da822cc91 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:32.007050 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-1f6d30f7-f83f-4b92-b0ad-e57da822cc91 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:32.014011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1f6d30f7-f83f-4b92-b0ad-e57da822cc91 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:32.014468 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1f6d30f7-f83f-4b92-b0ad-e57da822cc91 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:32.015447 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1f6d30f7-f83f-4b92-b0ad-e57da822cc91 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:32.015888 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1f6d30f7-f83f-4b92-b0ad-e57da822cc91 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:32.174101 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-1f6d30f7-f83f-4b92-b0ad-e57da822cc91 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:32.181739 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-1f6d30f7-f83f-4b92-b0ad-e57da822cc91 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1357 microversion: 2.1 time: 0.179182 May 16 17:43:32.182494 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 233/446] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:32 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:32.620898 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-6c89086c-440b-4991-91be-b4736cb806db tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:32.621882 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-6c89086c-440b-4991-91be-b4736cb806db tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:32.628081 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6c89086c-440b-4991-91be-b4736cb806db tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:32.628522 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6c89086c-440b-4991-91be-b4736cb806db tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:32.629293 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6c89086c-440b-4991-91be-b4736cb806db tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:32.629766 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6c89086c-440b-4991-91be-b4736cb806db tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:32.660074 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-6c89086c-440b-4991-91be-b4736cb806db tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043359 May 16 17:43:32.660633 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 214/447] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:43:32 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:33.199421 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-fdf257c4-4cbd-4e11-b72b-0e3f777c2612 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:33.200117 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-fdf257c4-4cbd-4e11-b72b-0e3f777c2612 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:33.211000 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fdf257c4-4cbd-4e11-b72b-0e3f777c2612 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:33.211474 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fdf257c4-4cbd-4e11-b72b-0e3f777c2612 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:33.212254 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fdf257c4-4cbd-4e11-b72b-0e3f777c2612 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:33.212715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fdf257c4-4cbd-4e11-b72b-0e3f777c2612 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:33.353806 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-fdf257c4-4cbd-4e11-b72b-0e3f777c2612 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:33.363013 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-fdf257c4-4cbd-4e11-b72b-0e3f777c2612 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1357 microversion: 2.1 time: 0.166266 May 16 17:43:33.363013 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 234/448] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:33 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:33.672371 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d00803e4-1fac-49bc-bc03-1b512402e34f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:33.673396 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d00803e4-1fac-49bc-bc03-1b512402e34f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:33.681925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d00803e4-1fac-49bc-bc03-1b512402e34f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:33.682432 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d00803e4-1fac-49bc-bc03-1b512402e34f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:33.683321 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d00803e4-1fac-49bc-bc03-1b512402e34f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:33.683914 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d00803e4-1fac-49bc-bc03-1b512402e34f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:33.718831 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d00803e4-1fac-49bc-bc03-1b512402e34f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050889 May 16 17:43:33.719418 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 215/449] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:43:33 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:34.379921 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f9cd1863-05a9-482f-9c31-a9d2a17a68e7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:34.380632 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-f9cd1863-05a9-482f-9c31-a9d2a17a68e7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:34.387282 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f9cd1863-05a9-482f-9c31-a9d2a17a68e7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:34.388022 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f9cd1863-05a9-482f-9c31-a9d2a17a68e7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:34.389100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f9cd1863-05a9-482f-9c31-a9d2a17a68e7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:34.389525 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f9cd1863-05a9-482f-9c31-a9d2a17a68e7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:34.521967 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-f9cd1863-05a9-482f-9c31-a9d2a17a68e7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:34.529497 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f9cd1863-05a9-482f-9c31-a9d2a17a68e7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1357 microversion: 2.1 time: 0.153462 May 16 17:43:34.530095 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 235/450] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:34 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:34.730132 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c4726f13-4024-46a6-abc8-a00536dfce14 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:34.731055 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-c4726f13-4024-46a6-abc8-a00536dfce14 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:34.737467 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c4726f13-4024-46a6-abc8-a00536dfce14 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:34.738173 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c4726f13-4024-46a6-abc8-a00536dfce14 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:34.739191 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c4726f13-4024-46a6-abc8-a00536dfce14 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:34.739614 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c4726f13-4024-46a6-abc8-a00536dfce14 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:34.770753 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-c4726f13-4024-46a6-abc8-a00536dfce14 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044338 May 16 17:43:34.771337 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 216/451] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:43:34 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:35.547719 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-30b1505e-09b7-4f0a-850e-2a93d5ad5934 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:35.548365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-30b1505e-09b7-4f0a-850e-2a93d5ad5934 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:35.554847 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-30b1505e-09b7-4f0a-850e-2a93d5ad5934 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:35.555408 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-30b1505e-09b7-4f0a-850e-2a93d5ad5934 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:35.556191 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-30b1505e-09b7-4f0a-850e-2a93d5ad5934 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:35.556828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-30b1505e-09b7-4f0a-850e-2a93d5ad5934 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:35.688184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-30b1505e-09b7-4f0a-850e-2a93d5ad5934 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:35.696139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-30b1505e-09b7-4f0a-850e-2a93d5ad5934 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1357 microversion: 2.1 time: 0.152627 May 16 17:43:35.696715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 236/452] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:35 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:35.782660 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-bb8b4ad0-aaa6-4f66-8a9d-c4d218b14bf2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:35.783712 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-bb8b4ad0-aaa6-4f66-8a9d-c4d218b14bf2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:35.790348 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bb8b4ad0-aaa6-4f66-8a9d-c4d218b14bf2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:35.791111 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bb8b4ad0-aaa6-4f66-8a9d-c4d218b14bf2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:35.792124 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bb8b4ad0-aaa6-4f66-8a9d-c4d218b14bf2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:35.792857 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bb8b4ad0-aaa6-4f66-8a9d-c4d218b14bf2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:35.833080 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-bb8b4ad0-aaa6-4f66-8a9d-c4d218b14bf2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054281 May 16 17:43:35.833566 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 217/453] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:43:35 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:36.715377 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-516f619e-99a3-4944-90f1-e2e281aa2cda tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:36.716027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-516f619e-99a3-4944-90f1-e2e281aa2cda tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:36.723061 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-516f619e-99a3-4944-90f1-e2e281aa2cda tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:36.723508 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-516f619e-99a3-4944-90f1-e2e281aa2cda tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:36.724278 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-516f619e-99a3-4944-90f1-e2e281aa2cda tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:36.724700 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-516f619e-99a3-4944-90f1-e2e281aa2cda tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:36.846137 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f303393a-28d8-4402-8c7c-8de60a500c3e tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:36.848520 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-f303393a-28d8-4402-8c7c-8de60a500c3e tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:36.855809 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f303393a-28d8-4402-8c7c-8de60a500c3e tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:36.856704 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f303393a-28d8-4402-8c7c-8de60a500c3e tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:36.857753 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f303393a-28d8-4402-8c7c-8de60a500c3e tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:36.858382 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f303393a-28d8-4402-8c7c-8de60a500c3e tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:36.863755 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-516f619e-99a3-4944-90f1-e2e281aa2cda tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:36.871072 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-516f619e-99a3-4944-90f1-e2e281aa2cda tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1357 microversion: 2.1 time: 0.160025 May 16 17:43:36.871718 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 237/454] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:36 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:36.888340 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f303393a-28d8-4402-8c7c-8de60a500c3e tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047809 May 16 17:43:36.888968 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 218/455] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:43:36 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:37.888357 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-7fdbea52-8ead-4642-b365-38212f4a217e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:37.888990 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-7fdbea52-8ead-4642-b365-38212f4a217e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:37.895946 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7fdbea52-8ead-4642-b365-38212f4a217e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:37.896390 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7fdbea52-8ead-4642-b365-38212f4a217e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:37.897151 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7fdbea52-8ead-4642-b365-38212f4a217e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:37.897714 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7fdbea52-8ead-4642-b365-38212f4a217e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:37.900357 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-986f13d5-84ac-4d9c-b951-2b0c4e6f5713 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:37.901282 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-986f13d5-84ac-4d9c-b951-2b0c4e6f5713 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:37.907787 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-986f13d5-84ac-4d9c-b951-2b0c4e6f5713 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:37.908231 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-986f13d5-84ac-4d9c-b951-2b0c4e6f5713 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:37.909001 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-986f13d5-84ac-4d9c-b951-2b0c4e6f5713 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:37.909431 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-986f13d5-84ac-4d9c-b951-2b0c4e6f5713 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:37.939646 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-986f13d5-84ac-4d9c-b951-2b0c4e6f5713 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043082 May 16 17:43:37.940178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 219/456] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:43:37 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:43:37.944849 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-753c085a-b601-4965-bb84-4d7db0595719 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20c7aac5-4970-47e1-a405-fa325a327c54"}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:43:37.945941 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-753c085a-b601-4965-bb84-4d7db0595719 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:37.952215 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-753c085a-b601-4965-bb84-4d7db0595719 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:37.952918 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-753c085a-b601-4965-bb84-4d7db0595719 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:37.953425 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-753c085a-b601-4965-bb84-4d7db0595719 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:37.953885 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-753c085a-b601-4965-bb84-4d7db0595719 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:38.035675 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-7fdbea52-8ead-4642-b365-38212f4a217e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:38.043480 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-7fdbea52-8ead-4642-b365-38212f4a217e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1357 microversion: 2.1 time: 0.159090 May 16 17:43:38.044061 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 238/457] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:37 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:38.784048 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-753c085a-b601-4965-bb84-4d7db0595719 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "POST /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.842633 May 16 17:43:38.784678 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 220/458] 10.222.0.58 () {60 vars in 1322 bytes} [Mon May 16 17:43:37 2022] POST /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-volume_attachments => generated 194 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:38.950438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-3be29453-0b5d-4ea3-9e79-034b571dcced tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:38.951378 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-3be29453-0b5d-4ea3-9e79-034b571dcced tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:38.958095 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3be29453-0b5d-4ea3-9e79-034b571dcced tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:38.958542 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3be29453-0b5d-4ea3-9e79-034b571dcced tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:38.959308 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3be29453-0b5d-4ea3-9e79-034b571dcced tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:38.959740 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3be29453-0b5d-4ea3-9e79-034b571dcced tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:38.988094 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-3be29453-0b5d-4ea3-9e79-034b571dcced tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041709 May 16 17:43:38.988690 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 239/459] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:43:38 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 17:43:39.050396 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d033d565-ce0e-4386-837a-c25171f13e28 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:39.051779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d033d565-ce0e-4386-837a-c25171f13e28 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:39.058416 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d033d565-ce0e-4386-837a-c25171f13e28 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:39.059313 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d033d565-ce0e-4386-837a-c25171f13e28 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:39.060258 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d033d565-ce0e-4386-837a-c25171f13e28 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:39.060888 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d033d565-ce0e-4386-837a-c25171f13e28 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:39.062870 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-51d8d7f0-947f-4c87-9edc-b268cf6bee22 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:39.063662 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-51d8d7f0-947f-4c87-9edc-b268cf6bee22 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:39.074059 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-51d8d7f0-947f-4c87-9edc-b268cf6bee22 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:39.074784 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-51d8d7f0-947f-4c87-9edc-b268cf6bee22 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:39.075766 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-51d8d7f0-947f-4c87-9edc-b268cf6bee22 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:39.076190 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-51d8d7f0-947f-4c87-9edc-b268cf6bee22 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:39.087881 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d033d565-ce0e-4386-837a-c25171f13e28 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Going to try to terminate instance {{(pid=128816) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:43:39.175560 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d033d565-ce0e-4386-837a-c25171f13e28 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "DELETE /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 204 len: 0 microversion: 2.1 time: 0.129215 May 16 17:43:39.176541 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 221/460] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:43:39 2022] DELETE /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:43:39.186116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-fd824b91-6d82-4af6-b5fc-91c72fba655f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:39.187151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-fd824b91-6d82-4af6-b5fc-91c72fba655f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:39.193361 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fd824b91-6d82-4af6-b5fc-91c72fba655f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:39.194055 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fd824b91-6d82-4af6-b5fc-91c72fba655f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:39.194831 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fd824b91-6d82-4af6-b5fc-91c72fba655f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:39.195258 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fd824b91-6d82-4af6-b5fc-91c72fba655f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:39.302822 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-51d8d7f0-947f-4c87-9edc-b268cf6bee22 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:39.310421 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-51d8d7f0-947f-4c87-9edc-b268cf6bee22 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1357 microversion: 2.1 time: 0.253441 May 16 17:43:39.311005 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 240/461] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:39 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:39.418911 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-fd824b91-6d82-4af6-b5fc-91c72fba655f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:39.427108 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-fd824b91-6d82-4af6-b5fc-91c72fba655f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1680 microversion: 2.1 time: 0.245981 May 16 17:43:39.427743 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 222/462] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:39 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1680 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:39.461943 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-9c50ee3c-5039-4714-9167-184a6b6c2114 req-6073874a-a0ab-48be-ad13-2528b0b9b6ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1928d55-33be-43a7-9d30-fcee59478af9", "tag": "aa1eb09f-24cd-4a34-b6e7-2d41f1534a63"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:43:39.469982 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-9c50ee3c-5039-4714-9167-184a6b6c2114 req-6073874a-a0ab-48be-ad13-2528b0b9b6ff service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:39.470237 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-9c50ee3c-5039-4714-9167-184a6b6c2114 req-6073874a-a0ab-48be-ad13-2528b0b9b6ff service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:39.482211 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-9c50ee3c-5039-4714-9167-184a6b6c2114 req-6073874a-a0ab-48be-ad13-2528b0b9b6ff service nova] Creating event network-changed:aa1eb09f-24cd-4a34-b6e7-2d41f1534a63 for instance e1928d55-33be-43a7-9d30-fcee59478af9 on hv-cinder-83769 May 16 17:43:39.487680 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-9c50ee3c-5039-4714-9167-184a6b6c2114 req-6073874a-a0ab-48be-ad13-2528b0b9b6ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029703 May 16 17:43:39.488190 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 241/463] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:43:40.332489 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ed4c1201-7118-4bc6-b34c-11f6afeda55a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:40.333441 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-ed4c1201-7118-4bc6-b34c-11f6afeda55a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:40.343384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ed4c1201-7118-4bc6-b34c-11f6afeda55a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:40.343828 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ed4c1201-7118-4bc6-b34c-11f6afeda55a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:40.344590 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ed4c1201-7118-4bc6-b34c-11f6afeda55a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:40.345022 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ed4c1201-7118-4bc6-b34c-11f6afeda55a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:40.449746 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-a8989281-8139-4939-b584-9dd96511ffd3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:40.450486 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a8989281-8139-4939-b584-9dd96511ffd3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:40.457764 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a8989281-8139-4939-b584-9dd96511ffd3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:40.458133 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a8989281-8139-4939-b584-9dd96511ffd3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:40.458889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a8989281-8139-4939-b584-9dd96511ffd3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:40.459486 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a8989281-8139-4939-b584-9dd96511ffd3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:40.480289 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-ed4c1201-7118-4bc6-b34c-11f6afeda55a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:40.488050 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ed4c1201-7118-4bc6-b34c-11f6afeda55a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1357 microversion: 2.1 time: 0.162252 May 16 17:43:40.489413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 223/464] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:40 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:40.526413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a67574ce-021d-4f54-8167-b8560d42311d tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f5bd68e-6648-48aa-bbfe-6b20e4596e58", "device": "/dev/sdb"}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:43:40.528139 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a67574ce-021d-4f54-8167-b8560d42311d tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:40.534349 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a67574ce-021d-4f54-8167-b8560d42311d tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:40.534880 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a67574ce-021d-4f54-8167-b8560d42311d tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:40.535778 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a67574ce-021d-4f54-8167-b8560d42311d tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:40.536281 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a67574ce-021d-4f54-8167-b8560d42311d tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:40.587925 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-a8989281-8139-4939-b584-9dd96511ffd3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:40.595969 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-a8989281-8139-4939-b584-9dd96511ffd3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1680 microversion: 2.1 time: 0.150585 May 16 17:43:40.596656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 242/465] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:40 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:40.827389 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a67574ce-021d-4f54-8167-b8560d42311d tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "POST /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304827 May 16 17:43:40.827993 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 224/466] 10.222.0.58 () {60 vars in 1322 bytes} [Mon May 16 17:43:40 2022] POST /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:41.505788 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-3ac9a32a-8fad-495a-9cc7-efc4beaeaca0 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:41.506529 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-3ac9a32a-8fad-495a-9cc7-efc4beaeaca0 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:41.512978 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3ac9a32a-8fad-495a-9cc7-efc4beaeaca0 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:41.513454 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3ac9a32a-8fad-495a-9cc7-efc4beaeaca0 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:41.514322 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3ac9a32a-8fad-495a-9cc7-efc4beaeaca0 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:41.514723 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3ac9a32a-8fad-495a-9cc7-efc4beaeaca0 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:41.615098 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b91c10d1-3971-4e6c-9992-b6b366302310 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:41.615835 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b91c10d1-3971-4e6c-9992-b6b366302310 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:41.622981 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b91c10d1-3971-4e6c-9992-b6b366302310 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:41.623465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b91c10d1-3971-4e6c-9992-b6b366302310 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:41.624256 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b91c10d1-3971-4e6c-9992-b6b366302310 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:41.624694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b91c10d1-3971-4e6c-9992-b6b366302310 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:42.123455 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3ac9a32a-8fad-495a-9cc7-efc4beaeaca0 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:42.130962 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-3ac9a32a-8fad-495a-9cc7-efc4beaeaca0 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1357 microversion: 2.1 time: 0.629087 May 16 17:43:42.131172 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-b91c10d1-3971-4e6c-9992-b6b366302310 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:42.131539 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 243/467] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:41 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1357 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:42.142812 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b91c10d1-3971-4e6c-9992-b6b366302310 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1680 microversion: 2.1 time: 0.532541 May 16 17:43:42.149584 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 225/468] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:41 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1680 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:42.569994 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-f2a05bfc-f382-4503-86b7-36cf3d96372b req-3828c99a-e9e1-46b5-a32a-608c3f5e8a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ea3f0a-7300-45ed-8778-4ca04699ff84", "name": "network-vif-deleted", "tag": "210e9aa1-6c18-46a4-b1f6-904dc4e498d1"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:43:42.578690 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-f2a05bfc-f382-4503-86b7-36cf3d96372b req-3828c99a-e9e1-46b5-a32a-608c3f5e8a5a service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:42.579370 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-f2a05bfc-f382-4503-86b7-36cf3d96372b req-3828c99a-e9e1-46b5-a32a-608c3f5e8a5a service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:42.591208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-f2a05bfc-f382-4503-86b7-36cf3d96372b req-3828c99a-e9e1-46b5-a32a-608c3f5e8a5a service nova] Creating event network-vif-deleted:210e9aa1-6c18-46a4-b1f6-904dc4e498d1 for instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 on hv-cinder-83769 May 16 17:43:42.596376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-f2a05bfc-f382-4503-86b7-36cf3d96372b req-3828c99a-e9e1-46b5-a32a-608c3f5e8a5a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030144 May 16 17:43:42.596961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 244/469] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:43.150022 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-74b19220-60c0-4915-a858-5b2672cb15d7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:43.150598 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-74b19220-60c0-4915-a858-5b2672cb15d7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:43.158431 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-74b19220-60c0-4915-a858-5b2672cb15d7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:43.158889 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-74b19220-60c0-4915-a858-5b2672cb15d7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:43.159656 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-74b19220-60c0-4915-a858-5b2672cb15d7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:43.160100 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-74b19220-60c0-4915-a858-5b2672cb15d7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:43.160891 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-1a59fe39-bfc3-4c8f-9ba5-b048e032dfc2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:43.161584 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-1a59fe39-bfc3-4c8f-9ba5-b048e032dfc2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:43.168151 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1a59fe39-bfc3-4c8f-9ba5-b048e032dfc2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:43.168829 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1a59fe39-bfc3-4c8f-9ba5-b048e032dfc2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:43.169627 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1a59fe39-bfc3-4c8f-9ba5-b048e032dfc2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:43.170093 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1a59fe39-bfc3-4c8f-9ba5-b048e032dfc2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:43.255938 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-1a59fe39-bfc3-4c8f-9ba5-b048e032dfc2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:43.273204 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-1a59fe39-bfc3-4c8f-9ba5-b048e032dfc2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 200 len: 1613 microversion: 2.1 time: 0.116452 May 16 17:43:43.273832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 245/470] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:43 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 1613 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:43.325461 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-74b19220-60c0-4915-a858-5b2672cb15d7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:43.334350 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-74b19220-60c0-4915-a858-5b2672cb15d7 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1357 microversion: 2.1 time: 0.189759 May 16 17:43:43.335137 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 226/471] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:43 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:44.294808 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-655cacd0-61ad-4b89-a549-9d22d8f97b63 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:44.295496 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-655cacd0-61ad-4b89-a549-9d22d8f97b63 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:44.302687 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-655cacd0-61ad-4b89-a549-9d22d8f97b63 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:44.303156 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-655cacd0-61ad-4b89-a549-9d22d8f97b63 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:44.303976 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-655cacd0-61ad-4b89-a549-9d22d8f97b63 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:44.304423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-655cacd0-61ad-4b89-a549-9d22d8f97b63 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:44.318616 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-655cacd0-61ad-4b89-a549-9d22d8f97b63 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] HTTP exception thrown: Instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 could not be found. May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-655cacd0-61ad-4b89-a549-9d22d8f97b63 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Request method failure captured: May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 HTTP/1.1 May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigox4BWkjUGbMIvOn7lTkLppnWsYzIVQtNJHubTanufmvEHsiu_ONp3auIJGxAXU0K5GHn7jQDnT6YubbdzHrAJT45fAGoePZ3wwIuaMH8qkH2BLOah56kKB6Od9VwHk7uC0dRignIhl6Vtrx_s0xElsY95RDLsFnhdltcQlhJ0yFrss May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 80c60c24806542e889c070d519172e79 May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:43:44.320316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:43:44.321827 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80c60c24806542e889c070d519172e79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80c60c24806542e889c070d519172e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:43:44.321827 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:43:44.321827 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 80c60c24806542e889c070d519172e79 May 16 17:43:44.321827 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:43:44.321827 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:43:44.321827 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:43:44.321827 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:43:44.321827 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: 6838738598ce4d2186e7c0b6547868f6 May 16 17:43:44.321827 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:43:44.321827 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:43:44.321827 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 could not be found. May 16 17:43:44.321827 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': '79ea3f0a-7300-45ed-8778-4ca04699ff84'} May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 could not be found. May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:43:44.322597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:43:44.324011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:43:44.324011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:43:44.324011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:43:44.324011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:43:44.324011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:43:44.324011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:43:44.324011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:43:44.324011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 could not be found. May 16 17:43:44.324011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:43:44.324011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:43:44.324011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:43:44.324011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:43:44.324011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:43:44.324011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:43:44.324011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:43:44.324011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:43:44.324011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 could not be found. May 16 17:43:44.324011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:43:44.325389 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-655cacd0-61ad-4b89-a549-9d22d8f97b63 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Returning 404 to user: Instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:43:44.325389 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-655cacd0-61ad-4b89-a549-9d22d8f97b63 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 404 len: 111 microversion: 2.1 time: 0.033973 May 16 17:43:44.325389 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 246/472] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:44 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:43:44.331331 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ac3d61f2-50a6-4f43-8838-ab8ccc00e49c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '.version_select at 0x7f79a4c0fe50>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:44.351413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ac3d61f2-50a6-4f43-8838-ab8ccc00e49c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-384275017" status: 202 len: 0 microversion: 2.1 time: 0.023931 May 16 17:43:44.351995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 227/473] 10.222.0.58 () {58 vars in 1217 bytes} [Mon May 16 17:43:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-384275017 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:43:44.352942 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-b7451f07-f45c-4834-a876-ed95c1246f9e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:44.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b7451f07-f45c-4834-a876-ed95c1246f9e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:44.360233 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b7451f07-f45c-4834-a876-ed95c1246f9e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:44.360782 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b7451f07-f45c-4834-a876-ed95c1246f9e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:44.361568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b7451f07-f45c-4834-a876-ed95c1246f9e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:44.362031 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b7451f07-f45c-4834-a876-ed95c1246f9e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:44.498214 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b7451f07-f45c-4834-a876-ed95c1246f9e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:44.506037 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-b7451f07-f45c-4834-a876-ed95c1246f9e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1357 microversion: 2.1 time: 0.157875 May 16 17:43:44.506824 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 247/474] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:44 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:45.037102 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9cb89dc5-daff-4daf-b595-e29dbcbdd299 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Action: 'create', calling method: .version_select at 0x7f79a4b30f70>, body: {"keypair": {"name": "tempest-keypair-641678839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJ/xtX+33kej+dAcTJlVI3FZjVowIh+LpnSQzLkFTKNaZItPOkW7lz8Pbj3PhPffxSk5+QUFSVZHGu1fMWiYM/9+m1uheM810xsHKkXT2hPiB1MtTG/qsu7RBWjMCYmbw=="}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:43:45.052092 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-9cb89dc5-daff-4daf-b595-e29dbcbdd299 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Getting quotas for project 80c60c24806542e889c070d519172e79. Resources: {'key_pairs'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:43:45.056053 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-9cb89dc5-daff-4daf-b595-e29dbcbdd299 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Getting quotas for user 6838738598ce4d2186e7c0b6547868f6 and project 80c60c24806542e889c070d519172e79. Resources: {'key_pairs'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:43:45.080233 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-9cb89dc5-daff-4daf-b595-e29dbcbdd299 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047019 May 16 17:43:45.080868 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 228/475] 10.222.0.58 () {60 vars in 1158 bytes} [Mon May 16 17:43:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:45.523218 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-647ab609-bf89-4ce4-ae1a-ee6df64cda9c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:45.523859 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-647ab609-bf89-4ce4-ae1a-ee6df64cda9c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:45.530577 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-647ab609-bf89-4ce4-ae1a-ee6df64cda9c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:45.531021 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-647ab609-bf89-4ce4-ae1a-ee6df64cda9c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:45.531779 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-647ab609-bf89-4ce4-ae1a-ee6df64cda9c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:45.532219 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-647ab609-bf89-4ce4-ae1a-ee6df64cda9c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:45.659331 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-647ab609-bf89-4ce4-ae1a-ee6df64cda9c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:45.666997 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-647ab609-bf89-4ce4-ae1a-ee6df64cda9c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1357 microversion: 2.1 time: 0.147774 May 16 17:43:45.667876 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 248/476] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:45 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:46.449407 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-3d6f52cb-280b-429c-9ca7-addaab3e7752 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2032317829", "imageRef": "782bd628-ef1b-419c-99f5-2c312d1766a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28ed5c22-d613-46a9-98e4-5aa888da0e5a"}], "security_groups": [{"name": "tempest-securitygroup--500737327"}], "key_name": "tempest-keypair-641678839", "user_data": "}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:43:46.552771 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.network.neutron [None req-3d6f52cb-280b-429c-9ca7-addaab3e7752 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] validate_networks() for [('28ed5c22-d613-46a9-98e4-5aa888da0e5a', None, None, None, None, None)] {{(pid=128816) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:43:46.686953 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-a89ecffe-05e1-4031-8670-1cd09e3e48ce tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:46.688323 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a89ecffe-05e1-4031-8670-1cd09e3e48ce tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:46.695074 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a89ecffe-05e1-4031-8670-1cd09e3e48ce tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:46.695524 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a89ecffe-05e1-4031-8670-1cd09e3e48ce tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:46.696332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a89ecffe-05e1-4031-8670-1cd09e3e48ce tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:46.696770 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a89ecffe-05e1-4031-8670-1cd09e3e48ce tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:46.935878 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-a89ecffe-05e1-4031-8670-1cd09e3e48ce tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:46.943908 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-a89ecffe-05e1-4031-8670-1cd09e3e48ce tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1357 microversion: 2.1 time: 0.263453 May 16 17:43:46.944449 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 249/477] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:46 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1357 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:47.012740 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-3d6f52cb-280b-429c-9ca7-addaab3e7752 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Flavor limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:43:47.013165 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-3d6f52cb-280b-429c-9ca7-addaab3e7752 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Image limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:43:47.013850 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-3d6f52cb-280b-429c-9ca7-addaab3e7752 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Flavor pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:43:47.014405 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-3d6f52cb-280b-429c-9ca7-addaab3e7752 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Image pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:43:47.014871 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-3d6f52cb-280b-429c-9ca7-addaab3e7752 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:43:47.026701 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3d6f52cb-280b-429c-9ca7-addaab3e7752 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:47.027249 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3d6f52cb-280b-429c-9ca7-addaab3e7752 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:47.028417 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3d6f52cb-280b-429c-9ca7-addaab3e7752 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:47.029010 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3d6f52cb-280b-429c-9ca7-addaab3e7752 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:47.048404 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-3d6f52cb-280b-429c-9ca7-addaab3e7752 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Getting quotas for project 80c60c24806542e889c070d519172e79. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:43:47.052553 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-3d6f52cb-280b-429c-9ca7-addaab3e7752 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Getting quotas for user 6838738598ce4d2186e7c0b6547868f6 and project 80c60c24806542e889c070d519172e79. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:43:47.064010 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-3d6f52cb-280b-429c-9ca7-addaab3e7752 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Going to run 1 instances... {{(pid=128816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:43:47.066534 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-3d6f52cb-280b-429c-9ca7-addaab3e7752 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='782bd628-ef1b-419c-99f5-2c312d1766a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:43:47.111720 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-3d6f52cb-280b-429c-9ca7-addaab3e7752 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.667136 May 16 17:43:47.112361 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 229/478] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:43:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:43:47.122693 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5e6198a0-3dbd-4f03-8549-6a2b3db24949 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:47.123368 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-5e6198a0-3dbd-4f03-8549-6a2b3db24949 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:47.176958 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-5e6198a0-3dbd-4f03-8549-6a2b3db24949 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:47.184062 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-5e6198a0-3dbd-4f03-8549-6a2b3db24949 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1241 microversion: 2.1 time: 0.065330 May 16 17:43:47.184710 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 250/479] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:47 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:47.403462 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b5498fef-1a38-4e60-80af-b8f83b039100 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:43:47.404501 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b5498fef-1a38-4e60-80af-b8f83b039100 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:47.410530 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b5498fef-1a38-4e60-80af-b8f83b039100 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:47.410891 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b5498fef-1a38-4e60-80af-b8f83b039100 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:47.411663 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b5498fef-1a38-4e60-80af-b8f83b039100 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:47.412092 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b5498fef-1a38-4e60-80af-b8f83b039100 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:47.438348 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-b5498fef-1a38-4e60-80af-b8f83b039100 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lazy-loading 'flavor' on Instance uuid ae780970-4212-46bc-8038-69067eb4e039 {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:43:47.605449 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b5498fef-1a38-4e60-80af-b8f83b039100 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "POST /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/action" status: 200 len: 32 microversion: 2.1 time: 0.205969 May 16 17:43:47.606085 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 230/480] 10.222.0.58 () {60 vars in 1277 bytes} [Mon May 16 17:43:47 2022] POST /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/action => generated 32 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 17:43:47.615149 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-3d6a5686-c705-4d72-a49b-5fcef3581ad1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:47.615756 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-3d6a5686-c705-4d72-a49b-5fcef3581ad1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:47.622177 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3d6a5686-c705-4d72-a49b-5fcef3581ad1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:47.622962 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3d6a5686-c705-4d72-a49b-5fcef3581ad1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:47.623806 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3d6a5686-c705-4d72-a49b-5fcef3581ad1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:47.624308 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3d6a5686-c705-4d72-a49b-5fcef3581ad1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:47.785817 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3d6a5686-c705-4d72-a49b-5fcef3581ad1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:47.794533 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-3d6a5686-c705-4d72-a49b-5fcef3581ad1 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1735 microversion: 2.1 time: 0.183198 May 16 17:43:47.795113 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 251/481] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:47 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:47.966535 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d4c42b30-1ca5-48e0-9b97-77472f547206 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:47.968581 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d4c42b30-1ca5-48e0-9b97-77472f547206 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:47.991076 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d4c42b30-1ca5-48e0-9b97-77472f547206 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:47.991525 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d4c42b30-1ca5-48e0-9b97-77472f547206 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:47.992314 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d4c42b30-1ca5-48e0-9b97-77472f547206 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:47.993587 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d4c42b30-1ca5-48e0-9b97-77472f547206 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:48.172365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-5be684ea-f497-49ee-9032-2aa13bb175e6 req-998e7ff0-af7f-4ff9-9679-e9369dce89b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1928d55-33be-43a7-9d30-fcee59478af9", "name": "network-vif-plugged", "status": "completed", "tag": "aa1eb09f-24cd-4a34-b6e7-2d41f1534a63"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:43:48.184168 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-5be684ea-f497-49ee-9032-2aa13bb175e6 req-998e7ff0-af7f-4ff9-9679-e9369dce89b5 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:48.185201 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-5be684ea-f497-49ee-9032-2aa13bb175e6 req-998e7ff0-af7f-4ff9-9679-e9369dce89b5 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:48.196948 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-5be684ea-f497-49ee-9032-2aa13bb175e6 req-998e7ff0-af7f-4ff9-9679-e9369dce89b5 service nova] Creating event network-vif-plugged:aa1eb09f-24cd-4a34-b6e7-2d41f1534a63 for instance e1928d55-33be-43a7-9d30-fcee59478af9 on hv-cinder-83769 May 16 17:43:48.204880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-5be684ea-f497-49ee-9032-2aa13bb175e6 req-998e7ff0-af7f-4ff9-9679-e9369dce89b5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037200 May 16 17:43:48.205829 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 252/482] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:43:48.213677 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-b4ac28df-4dc9-4c10-b14d-984b8e76dff8 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:48.214958 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b4ac28df-4dc9-4c10-b14d-984b8e76dff8 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:48.222465 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b4ac28df-4dc9-4c10-b14d-984b8e76dff8 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:48.223226 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b4ac28df-4dc9-4c10-b14d-984b8e76dff8 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:48.224206 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b4ac28df-4dc9-4c10-b14d-984b8e76dff8 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:48.224837 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b4ac28df-4dc9-4c10-b14d-984b8e76dff8 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:48.319719 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d4c42b30-1ca5-48e0-9b97-77472f547206 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:48.325744 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b4ac28df-4dc9-4c10-b14d-984b8e76dff8 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:48.328424 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d4c42b30-1ca5-48e0-9b97-77472f547206 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1357 microversion: 2.1 time: 0.369319 May 16 17:43:48.329000 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 231/483] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:47 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1357 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:48.339705 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-b4ac28df-4dc9-4c10-b14d-984b8e76dff8 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1299 microversion: 2.1 time: 0.132489 May 16 17:43:48.340310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 253/484] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:48 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1299 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:48.811867 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-7249fa19-f70a-47ae-b554-71a86ca126c9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:48.812458 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-7249fa19-f70a-47ae-b554-71a86ca126c9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:48.819437 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7249fa19-f70a-47ae-b554-71a86ca126c9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:48.819906 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7249fa19-f70a-47ae-b554-71a86ca126c9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:48.820675 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7249fa19-f70a-47ae-b554-71a86ca126c9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:48.821105 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7249fa19-f70a-47ae-b554-71a86ca126c9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:49.027660 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-7249fa19-f70a-47ae-b554-71a86ca126c9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:49.035657 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-7249fa19-f70a-47ae-b554-71a86ca126c9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1735 microversion: 2.1 time: 0.227703 May 16 17:43:49.036237 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 232/485] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:48 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:49.344472 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-974d95e3-77ea-4ccf-b881-d6f6aa19c51a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:49.345116 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-974d95e3-77ea-4ccf-b881-d6f6aa19c51a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:49.356276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d9cbcce4-04e2-43fb-bf17-103e0e631ecc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:49.356877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d9cbcce4-04e2-43fb-bf17-103e0e631ecc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:49.359174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-974d95e3-77ea-4ccf-b881-d6f6aa19c51a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:49.360786 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-974d95e3-77ea-4ccf-b881-d6f6aa19c51a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:49.363468 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-974d95e3-77ea-4ccf-b881-d6f6aa19c51a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:49.364371 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-974d95e3-77ea-4ccf-b881-d6f6aa19c51a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:49.365941 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d9cbcce4-04e2-43fb-bf17-103e0e631ecc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:49.366375 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d9cbcce4-04e2-43fb-bf17-103e0e631ecc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:49.367117 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d9cbcce4-04e2-43fb-bf17-103e0e631ecc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:49.370167 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d9cbcce4-04e2-43fb-bf17-103e0e631ecc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:49.728712 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-974d95e3-77ea-4ccf-b881-d6f6aa19c51a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:49.733424 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d9cbcce4-04e2-43fb-bf17-103e0e631ecc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:49.736206 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-974d95e3-77ea-4ccf-b881-d6f6aa19c51a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1357 microversion: 2.1 time: 0.395703 May 16 17:43:49.736774 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 254/486] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:49 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1357 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:49.750572 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d9cbcce4-04e2-43fb-bf17-103e0e631ecc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1366 microversion: 2.1 time: 0.398227 May 16 17:43:49.751259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 233/487] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:49 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1366 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:43:50.054350 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ca6b595d-31ca-436a-a58a-3b689c29b8d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:50.055487 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ca6b595d-31ca-436a-a58a-3b689c29b8d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:50.061889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ca6b595d-31ca-436a-a58a-3b689c29b8d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:50.062342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ca6b595d-31ca-436a-a58a-3b689c29b8d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:50.063119 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ca6b595d-31ca-436a-a58a-3b689c29b8d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:50.063552 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ca6b595d-31ca-436a-a58a-3b689c29b8d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:50.262650 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ca6b595d-31ca-436a-a58a-3b689c29b8d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:50.270824 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ca6b595d-31ca-436a-a58a-3b689c29b8d9 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1735 microversion: 2.1 time: 0.220549 May 16 17:43:50.271596 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 255/488] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:50 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:50.395122 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-7cdeaa7e-f207-420d-b53d-941e297e4acd req-25bea351-3d90-434d-9c8a-7148ce1abec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f2449e-7706-405a-9dc2-3c52e3df0489", "tag": "36a356f3-2d74-47dd-9eae-4601aa39ccb1"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:43:50.407423 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-7cdeaa7e-f207-420d-b53d-941e297e4acd req-25bea351-3d90-434d-9c8a-7148ce1abec2 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:50.407854 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-7cdeaa7e-f207-420d-b53d-941e297e4acd req-25bea351-3d90-434d-9c8a-7148ce1abec2 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:50.422457 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-7cdeaa7e-f207-420d-b53d-941e297e4acd req-25bea351-3d90-434d-9c8a-7148ce1abec2 service nova] Creating event network-changed:36a356f3-2d74-47dd-9eae-4601aa39ccb1 for instance 10f2449e-7706-405a-9dc2-3c52e3df0489 on hv-cinder-83769 May 16 17:43:50.427648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-7cdeaa7e-f207-420d-b53d-941e297e4acd req-25bea351-3d90-434d-9c8a-7148ce1abec2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037936 May 16 17:43:50.428738 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 234/489] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:50.752515 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e21ffdd2-2cb4-4a32-90b3-155d1ea3b1cc tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:50.753134 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-e21ffdd2-2cb4-4a32-90b3-155d1ea3b1cc tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:50.759737 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e21ffdd2-2cb4-4a32-90b3-155d1ea3b1cc tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:50.760188 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e21ffdd2-2cb4-4a32-90b3-155d1ea3b1cc tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:50.760994 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e21ffdd2-2cb4-4a32-90b3-155d1ea3b1cc tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:50.761406 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e21ffdd2-2cb4-4a32-90b3-155d1ea3b1cc tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:50.768098 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-cf6a22e9-647b-40e2-8a73-ac9cd6a4e7e0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:50.769016 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-cf6a22e9-647b-40e2-8a73-ac9cd6a4e7e0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:50.775522 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cf6a22e9-647b-40e2-8a73-ac9cd6a4e7e0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:50.776133 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cf6a22e9-647b-40e2-8a73-ac9cd6a4e7e0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:50.776973 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cf6a22e9-647b-40e2-8a73-ac9cd6a4e7e0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:50.777447 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cf6a22e9-647b-40e2-8a73-ac9cd6a4e7e0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:50.970653 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-e21ffdd2-2cb4-4a32-90b3-155d1ea3b1cc tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:50.973602 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-cf6a22e9-647b-40e2-8a73-ac9cd6a4e7e0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:50.978670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-e21ffdd2-2cb4-4a32-90b3-155d1ea3b1cc tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1547 microversion: 2.1 time: 0.230088 May 16 17:43:50.979243 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 256/490] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:50 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1547 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:50.982183 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-cf6a22e9-647b-40e2-8a73-ac9cd6a4e7e0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1366 microversion: 2.1 time: 0.218096 May 16 17:43:50.982939 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 235/491] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:50 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:43:50.998623 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-9a06096e-ca4a-419a-99d9-9bdcd73b2128 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:50.999261 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-9a06096e-ca4a-419a-99d9-9bdcd73b2128 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:51.005096 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9a06096e-ca4a-419a-99d9-9bdcd73b2128 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:51.005565 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9a06096e-ca4a-419a-99d9-9bdcd73b2128 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:51.006340 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9a06096e-ca4a-419a-99d9-9bdcd73b2128 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:51.006773 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9a06096e-ca4a-419a-99d9-9bdcd73b2128 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:51.139313 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-9a06096e-ca4a-419a-99d9-9bdcd73b2128 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:51.146903 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-9a06096e-ca4a-419a-99d9-9bdcd73b2128 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1547 microversion: 2.1 time: 0.154067 May 16 17:43:51.147476 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 257/492] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:50 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:51.164489 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b2846b6f-1807-4c15-9415-413ce3878647 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:51.168221 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-b2846b6f-1807-4c15-9415-413ce3878647 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:51.168976 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b2846b6f-1807-4c15-9415-413ce3878647 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Searching by: {'deleted': False, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13'} {{(pid=128816) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 16 17:43:51.175952 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b2846b6f-1807-4c15-9415-413ce3878647 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:51.176399 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b2846b6f-1807-4c15-9415-413ce3878647 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:51.177199 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b2846b6f-1807-4c15-9415-413ce3878647 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:51.177656 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b2846b6f-1807-4c15-9415-413ce3878647 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:51.269510 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.multi_cell_list [None req-b2846b6f-1807-4c15-9415-413ce3878647 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128816) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 16 17:43:51.288028 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-88dd7660-2107-4a3d-8169-225d16b76b36 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:51.288638 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-88dd7660-2107-4a3d-8169-225d16b76b36 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:51.295072 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-88dd7660-2107-4a3d-8169-225d16b76b36 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:51.295527 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-88dd7660-2107-4a3d-8169-225d16b76b36 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:51.296296 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-88dd7660-2107-4a3d-8169-225d16b76b36 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:51.296731 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-88dd7660-2107-4a3d-8169-225d16b76b36 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:51.362216 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b2846b6f-1807-4c15-9415-413ce3878647 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.201412 May 16 17:43:51.362829 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 236/493] 10.222.0.58 () {58 vars in 1124 bytes} [Mon May 16 17:43:51 2022] GET /compute/v2.1/servers => generated 343 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:51.372809 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-731686da-88e6-4c92-8f9c-e8a930f77114 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:51.373407 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-731686da-88e6-4c92-8f9c-e8a930f77114 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:51.379380 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-731686da-88e6-4c92-8f9c-e8a930f77114 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:51.379824 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-731686da-88e6-4c92-8f9c-e8a930f77114 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:51.380577 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-731686da-88e6-4c92-8f9c-e8a930f77114 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:51.380999 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-731686da-88e6-4c92-8f9c-e8a930f77114 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:51.439044 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-88dd7660-2107-4a3d-8169-225d16b76b36 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:51.447460 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-88dd7660-2107-4a3d-8169-225d16b76b36 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1735 microversion: 2.1 time: 0.163333 May 16 17:43:51.448178 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 258/494] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:51 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:51.520839 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-731686da-88e6-4c92-8f9c-e8a930f77114 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:51.528431 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-731686da-88e6-4c92-8f9c-e8a930f77114 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1547 microversion: 2.1 time: 0.159304 May 16 17:43:51.529074 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 237/495] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:51 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:43:52.000078 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-45aa524d-f040-48c6-b174-435249d07f25 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:52.000674 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-45aa524d-f040-48c6-b174-435249d07f25 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:52.008116 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-45aa524d-f040-48c6-b174-435249d07f25 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:52.008758 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-45aa524d-f040-48c6-b174-435249d07f25 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:52.009997 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-45aa524d-f040-48c6-b174-435249d07f25 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:52.010631 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-45aa524d-f040-48c6-b174-435249d07f25 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:52.180818 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-45aa524d-f040-48c6-b174-435249d07f25 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:52.188373 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-45aa524d-f040-48c6-b174-435249d07f25 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1366 microversion: 2.1 time: 0.192801 May 16 17:43:52.188931 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 259/496] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:51 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:52.467976 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e37962f9-0b8e-4b81-88b5-e08cca1e7578 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:52.468504 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e37962f9-0b8e-4b81-88b5-e08cca1e7578 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:52.475575 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e37962f9-0b8e-4b81-88b5-e08cca1e7578 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:52.476026 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e37962f9-0b8e-4b81-88b5-e08cca1e7578 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:52.476782 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e37962f9-0b8e-4b81-88b5-e08cca1e7578 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:52.477247 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e37962f9-0b8e-4b81-88b5-e08cca1e7578 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:52.645964 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e37962f9-0b8e-4b81-88b5-e08cca1e7578 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:52.654897 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e37962f9-0b8e-4b81-88b5-e08cca1e7578 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1735 microversion: 2.1 time: 0.192912 May 16 17:43:52.656020 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 238/497] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:52 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:53.050399 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-1753eb8b-ed2c-4522-9f03-6233b958026a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "202cb216-d561-4fc3-ad87-eb758daba63a"}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:43:53.051657 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-1753eb8b-ed2c-4522-9f03-6233b958026a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:53.058251 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1753eb8b-ed2c-4522-9f03-6233b958026a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:53.058838 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1753eb8b-ed2c-4522-9f03-6233b958026a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:53.059684 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1753eb8b-ed2c-4522-9f03-6233b958026a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:53.060475 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1753eb8b-ed2c-4522-9f03-6233b958026a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:53.206354 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-eefe9f17-872b-4eae-a2ae-3d667d74affb tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:53.211764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-eefe9f17-872b-4eae-a2ae-3d667d74affb tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:53.218697 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eefe9f17-872b-4eae-a2ae-3d667d74affb tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:53.219446 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eefe9f17-872b-4eae-a2ae-3d667d74affb tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:53.220237 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eefe9f17-872b-4eae-a2ae-3d667d74affb tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:53.220669 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-eefe9f17-872b-4eae-a2ae-3d667d74affb tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:53.319090 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-1753eb8b-ed2c-4522-9f03-6233b958026a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "POST /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272917 May 16 17:43:53.319796 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 260/498] 10.222.0.58 () {60 vars in 1322 bytes} [Mon May 16 17:43:53 2022] POST /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:43:53.421195 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-eefe9f17-872b-4eae-a2ae-3d667d74affb tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:53.430477 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-eefe9f17-872b-4eae-a2ae-3d667d74affb tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1366 microversion: 2.1 time: 0.230046 May 16 17:43:53.431037 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 239/499] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:53 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:43:53.674924 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-9b068d98-3618-447f-a6e0-3cba005991c0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:53.675620 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-9b068d98-3618-447f-a6e0-3cba005991c0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:53.681810 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9b068d98-3618-447f-a6e0-3cba005991c0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:53.682267 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9b068d98-3618-447f-a6e0-3cba005991c0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:53.683039 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9b068d98-3618-447f-a6e0-3cba005991c0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:53.683484 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9b068d98-3618-447f-a6e0-3cba005991c0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:53.825204 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-9b068d98-3618-447f-a6e0-3cba005991c0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:53.833757 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-9b068d98-3618-447f-a6e0-3cba005991c0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1735 microversion: 2.1 time: 0.163430 May 16 17:43:53.834620 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 261/500] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:53 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:54.450074 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f26263e7-3225-4753-8ba4-8905114d7683 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:54.450701 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-f26263e7-3225-4753-8ba4-8905114d7683 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:54.458876 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f26263e7-3225-4753-8ba4-8905114d7683 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:54.459422 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f26263e7-3225-4753-8ba4-8905114d7683 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:54.460208 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f26263e7-3225-4753-8ba4-8905114d7683 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:54.460627 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f26263e7-3225-4753-8ba4-8905114d7683 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:54.592269 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f26263e7-3225-4753-8ba4-8905114d7683 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:54.599734 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f26263e7-3225-4753-8ba4-8905114d7683 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1366 microversion: 2.1 time: 0.156081 May 16 17:43:54.600325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 240/501] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:54 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:54.855486 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-2c52af36-265f-4ef8-a0b5-42872f640518 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:54.856452 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-2c52af36-265f-4ef8-a0b5-42872f640518 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:54.863873 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2c52af36-265f-4ef8-a0b5-42872f640518 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:54.864356 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2c52af36-265f-4ef8-a0b5-42872f640518 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:54.865143 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2c52af36-265f-4ef8-a0b5-42872f640518 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:54.865584 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2c52af36-265f-4ef8-a0b5-42872f640518 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:55.002582 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-2c52af36-265f-4ef8-a0b5-42872f640518 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:55.010883 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-2c52af36-265f-4ef8-a0b5-42872f640518 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1735 microversion: 2.1 time: 0.161820 May 16 17:43:55.011459 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 262/502] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:54 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:55.616662 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c8eff9ce-0260-4062-ba7d-c38f028b0415 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:55.617315 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-c8eff9ce-0260-4062-ba7d-c38f028b0415 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:55.625060 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c8eff9ce-0260-4062-ba7d-c38f028b0415 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:55.625584 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c8eff9ce-0260-4062-ba7d-c38f028b0415 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:55.626459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c8eff9ce-0260-4062-ba7d-c38f028b0415 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:55.626943 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c8eff9ce-0260-4062-ba7d-c38f028b0415 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:55.786588 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-c8eff9ce-0260-4062-ba7d-c38f028b0415 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:55.794695 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-c8eff9ce-0260-4062-ba7d-c38f028b0415 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1366 microversion: 2.1 time: 0.182306 May 16 17:43:55.795340 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 241/503] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:55 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:56.027482 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-78adb4f0-181a-444d-9dd0-694d18341bb3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:56.028113 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-78adb4f0-181a-444d-9dd0-694d18341bb3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:56.035178 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-78adb4f0-181a-444d-9dd0-694d18341bb3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:56.035623 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-78adb4f0-181a-444d-9dd0-694d18341bb3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:56.036383 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-78adb4f0-181a-444d-9dd0-694d18341bb3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:56.036814 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-78adb4f0-181a-444d-9dd0-694d18341bb3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:56.169952 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-78adb4f0-181a-444d-9dd0-694d18341bb3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:56.177997 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-78adb4f0-181a-444d-9dd0-694d18341bb3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1735 microversion: 2.1 time: 0.154356 May 16 17:43:56.178568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 263/504] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:56 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:56.816113 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-7ea6a1b9-adea-4381-b5bc-521227069ee9 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:56.816958 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-7ea6a1b9-adea-4381-b5bc-521227069ee9 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:56.827849 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7ea6a1b9-adea-4381-b5bc-521227069ee9 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:56.828587 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7ea6a1b9-adea-4381-b5bc-521227069ee9 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:56.829910 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7ea6a1b9-adea-4381-b5bc-521227069ee9 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:56.830631 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7ea6a1b9-adea-4381-b5bc-521227069ee9 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:56.971089 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-7ea6a1b9-adea-4381-b5bc-521227069ee9 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:56.978572 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-7ea6a1b9-adea-4381-b5bc-521227069ee9 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1366 microversion: 2.1 time: 0.169100 May 16 17:43:56.979238 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 242/505] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:56 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:57.195354 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-1f8ea464-3c60-4b66-ad72-9c4b6d820737 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:57.196074 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-1f8ea464-3c60-4b66-ad72-9c4b6d820737 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:57.202578 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1f8ea464-3c60-4b66-ad72-9c4b6d820737 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:57.203027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1f8ea464-3c60-4b66-ad72-9c4b6d820737 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:57.203802 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1f8ea464-3c60-4b66-ad72-9c4b6d820737 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:57.204425 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1f8ea464-3c60-4b66-ad72-9c4b6d820737 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:57.340643 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-1f8ea464-3c60-4b66-ad72-9c4b6d820737 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:57.349327 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-1f8ea464-3c60-4b66-ad72-9c4b6d820737 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1735 microversion: 2.1 time: 0.158016 May 16 17:43:57.349866 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 264/506] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:57 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:57.999722 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c2accc32-888c-40c6-9ea4-2df570ded697 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:58.000767 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-c2accc32-888c-40c6-9ea4-2df570ded697 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:58.011624 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c2accc32-888c-40c6-9ea4-2df570ded697 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:58.012371 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c2accc32-888c-40c6-9ea4-2df570ded697 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:58.013644 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c2accc32-888c-40c6-9ea4-2df570ded697 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:58.014069 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c2accc32-888c-40c6-9ea4-2df570ded697 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:58.153237 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-c2accc32-888c-40c6-9ea4-2df570ded697 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:58.161334 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-c2accc32-888c-40c6-9ea4-2df570ded697 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1366 microversion: 2.1 time: 0.168060 May 16 17:43:58.161942 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 243/507] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:57 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:58.366587 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-78efd607-a792-49db-ba2e-bc7a5d535029 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:58.367198 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-78efd607-a792-49db-ba2e-bc7a5d535029 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:58.374076 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-78efd607-a792-49db-ba2e-bc7a5d535029 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:58.374526 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-78efd607-a792-49db-ba2e-bc7a5d535029 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:58.375294 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-78efd607-a792-49db-ba2e-bc7a5d535029 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:58.375731 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-78efd607-a792-49db-ba2e-bc7a5d535029 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:58.511755 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-78efd607-a792-49db-ba2e-bc7a5d535029 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:58.520052 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-78efd607-a792-49db-ba2e-bc7a5d535029 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1735 microversion: 2.1 time: 0.157400 May 16 17:43:58.520635 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 265/508] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:58 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:59.178723 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d173801c-b880-4cb5-8ae9-fe7f308dd17d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:59.179314 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d173801c-b880-4cb5-8ae9-fe7f308dd17d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:59.185956 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d173801c-b880-4cb5-8ae9-fe7f308dd17d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:59.186401 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d173801c-b880-4cb5-8ae9-fe7f308dd17d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:59.187200 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d173801c-b880-4cb5-8ae9-fe7f308dd17d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:59.187624 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d173801c-b880-4cb5-8ae9-fe7f308dd17d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:59.318699 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d173801c-b880-4cb5-8ae9-fe7f308dd17d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:59.326427 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d173801c-b880-4cb5-8ae9-fe7f308dd17d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1366 microversion: 2.1 time: 0.151749 May 16 17:43:59.326990 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 244/509] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:59 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:43:59.541487 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-6c056bb6-b5a8-4c19-a714-5ab8f232bd17 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:43:59.542911 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-6c056bb6-b5a8-4c19-a714-5ab8f232bd17 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:43:59.550633 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6c056bb6-b5a8-4c19-a714-5ab8f232bd17 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:59.551111 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6c056bb6-b5a8-4c19-a714-5ab8f232bd17 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:59.551923 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6c056bb6-b5a8-4c19-a714-5ab8f232bd17 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:43:59.552392 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6c056bb6-b5a8-4c19-a714-5ab8f232bd17 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:43:59.683864 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-6c056bb6-b5a8-4c19-a714-5ab8f232bd17 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:43:59.692077 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-6c056bb6-b5a8-4c19-a714-5ab8f232bd17 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1735 microversion: 2.1 time: 0.157112 May 16 17:43:59.692650 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 266/510] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:43:59 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:00.347607 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-35fabd7a-f820-4b3d-acc6-6b494b42bda5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:00.348660 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-35fabd7a-f820-4b3d-acc6-6b494b42bda5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:00.358395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-35fabd7a-f820-4b3d-acc6-6b494b42bda5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:00.358846 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-35fabd7a-f820-4b3d-acc6-6b494b42bda5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:00.359611 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-35fabd7a-f820-4b3d-acc6-6b494b42bda5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:00.360044 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-35fabd7a-f820-4b3d-acc6-6b494b42bda5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:00.493575 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-35fabd7a-f820-4b3d-acc6-6b494b42bda5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:00.501216 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-35fabd7a-f820-4b3d-acc6-6b494b42bda5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1366 microversion: 2.1 time: 0.160395 May 16 17:44:00.501830 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 245/511] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:00 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:00.645239 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-07a710f3-aafc-4623-a43f-ca24354cbbe7 req-cedacd00-c58a-430a-a0de-10e807450058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f2449e-7706-405a-9dc2-3c52e3df0489", "name": "network-vif-plugged", "status": "completed", "tag": "36a356f3-2d74-47dd-9eae-4601aa39ccb1"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:44:00.654020 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-07a710f3-aafc-4623-a43f-ca24354cbbe7 req-cedacd00-c58a-430a-a0de-10e807450058 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:00.654526 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-07a710f3-aafc-4623-a43f-ca24354cbbe7 req-cedacd00-c58a-430a-a0de-10e807450058 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:00.665707 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-07a710f3-aafc-4623-a43f-ca24354cbbe7 req-cedacd00-c58a-430a-a0de-10e807450058 service nova] Creating event network-vif-plugged:36a356f3-2d74-47dd-9eae-4601aa39ccb1 for instance 10f2449e-7706-405a-9dc2-3c52e3df0489 on hv-cinder-83769 May 16 17:44:00.670995 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-07a710f3-aafc-4623-a43f-ca24354cbbe7 req-cedacd00-c58a-430a-a0de-10e807450058 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029544 May 16 17:44:00.671594 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 267/512] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:44:00.709631 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-30268c86-a747-4e9b-b61c-fc29fccd0676 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:00.710272 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-30268c86-a747-4e9b-b61c-fc29fccd0676 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:00.716461 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-30268c86-a747-4e9b-b61c-fc29fccd0676 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:00.716936 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-30268c86-a747-4e9b-b61c-fc29fccd0676 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:00.717731 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-30268c86-a747-4e9b-b61c-fc29fccd0676 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:00.718158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-30268c86-a747-4e9b-b61c-fc29fccd0676 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:00.848520 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-30268c86-a747-4e9b-b61c-fc29fccd0676 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:00.856436 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-30268c86-a747-4e9b-b61c-fc29fccd0676 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1735 microversion: 2.1 time: 0.151947 May 16 17:44:00.857079 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 246/513] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:00 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:01.518721 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f3c4de85-1035-4056-95bc-f13f0d227867 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:01.519453 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-f3c4de85-1035-4056-95bc-f13f0d227867 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:01.525878 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f3c4de85-1035-4056-95bc-f13f0d227867 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:01.526329 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f3c4de85-1035-4056-95bc-f13f0d227867 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:01.527088 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f3c4de85-1035-4056-95bc-f13f0d227867 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:01.527523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f3c4de85-1035-4056-95bc-f13f0d227867 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:01.673603 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-f3c4de85-1035-4056-95bc-f13f0d227867 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:01.681745 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f3c4de85-1035-4056-95bc-f13f0d227867 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1366 microversion: 2.1 time: 0.167223 May 16 17:44:01.682348 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 268/514] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:01 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:01.873838 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-5dd994b2-cb40-4f25-ae57-216753d22555 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:01.874355 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-5dd994b2-cb40-4f25-ae57-216753d22555 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:01.880934 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5dd994b2-cb40-4f25-ae57-216753d22555 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:01.881393 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5dd994b2-cb40-4f25-ae57-216753d22555 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:01.882189 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5dd994b2-cb40-4f25-ae57-216753d22555 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:01.882628 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5dd994b2-cb40-4f25-ae57-216753d22555 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:01.968912 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-a0162a51-7ccc-4e68-b904-bc2a46665a18 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:01.969516 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a0162a51-7ccc-4e68-b904-bc2a46665a18 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:01.975684 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a0162a51-7ccc-4e68-b904-bc2a46665a18 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:01.976129 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a0162a51-7ccc-4e68-b904-bc2a46665a18 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:01.977144 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a0162a51-7ccc-4e68-b904-bc2a46665a18 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:01.977275 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a0162a51-7ccc-4e68-b904-bc2a46665a18 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:02.013579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-5dd994b2-cb40-4f25-ae57-216753d22555 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:02.021759 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-5dd994b2-cb40-4f25-ae57-216753d22555 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1735 microversion: 2.1 time: 0.152044 May 16 17:44:02.022432 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 247/515] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:01 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:02.112137 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-a0162a51-7ccc-4e68-b904-bc2a46665a18 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:02.120556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-a0162a51-7ccc-4e68-b904-bc2a46665a18 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1593 microversion: 2.1 time: 0.155754 May 16 17:44:02.121128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 269/516] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:01 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1593 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:44:02.699812 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-16513d75-a51c-4978-bdef-54774529a38c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:02.700330 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-16513d75-a51c-4978-bdef-54774529a38c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:02.706786 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-16513d75-a51c-4978-bdef-54774529a38c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:02.707213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-16513d75-a51c-4978-bdef-54774529a38c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:02.708003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-16513d75-a51c-4978-bdef-54774529a38c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:02.708440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-16513d75-a51c-4978-bdef-54774529a38c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:02.924721 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-16513d75-a51c-4978-bdef-54774529a38c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:02.932162 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-16513d75-a51c-4978-bdef-54774529a38c tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1366 microversion: 2.1 time: 0.236676 May 16 17:44:02.932726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 248/517] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:02 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:03.039519 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-a350c4fe-7498-4359-a32a-60285075ba20 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:03.040186 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a350c4fe-7498-4359-a32a-60285075ba20 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:03.047771 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a350c4fe-7498-4359-a32a-60285075ba20 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:03.048246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a350c4fe-7498-4359-a32a-60285075ba20 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:03.049031 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a350c4fe-7498-4359-a32a-60285075ba20 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:03.049456 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a350c4fe-7498-4359-a32a-60285075ba20 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:03.251457 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-a350c4fe-7498-4359-a32a-60285075ba20 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:03.259622 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-a350c4fe-7498-4359-a32a-60285075ba20 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1735 microversion: 2.1 time: 0.224358 May 16 17:44:03.260529 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 270/518] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:03 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:03.950199 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-7ef0e16e-2608-47e8-b60f-a1176db73864 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:03.950910 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-7ef0e16e-2608-47e8-b60f-a1176db73864 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:03.957332 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7ef0e16e-2608-47e8-b60f-a1176db73864 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:03.957807 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7ef0e16e-2608-47e8-b60f-a1176db73864 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:03.958584 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7ef0e16e-2608-47e8-b60f-a1176db73864 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:03.959367 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7ef0e16e-2608-47e8-b60f-a1176db73864 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:03.962809 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-3a860e56-d550-4931-8e73-d9bd8ee3edf3 req-731f080d-2625-4e23-9d78-46bae65750f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1928d55-33be-43a7-9d30-fcee59478af9", "tag": "aa1eb09f-24cd-4a34-b6e7-2d41f1534a63"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:44:03.971383 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-3a860e56-d550-4931-8e73-d9bd8ee3edf3 req-731f080d-2625-4e23-9d78-46bae65750f1 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:03.971643 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-3a860e56-d550-4931-8e73-d9bd8ee3edf3 req-731f080d-2625-4e23-9d78-46bae65750f1 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:03.984573 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-3a860e56-d550-4931-8e73-d9bd8ee3edf3 req-731f080d-2625-4e23-9d78-46bae65750f1 service nova] Creating event network-changed:aa1eb09f-24cd-4a34-b6e7-2d41f1534a63 for instance e1928d55-33be-43a7-9d30-fcee59478af9 on hv-cinder-83769 May 16 17:44:03.990003 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-3a860e56-d550-4931-8e73-d9bd8ee3edf3 req-731f080d-2625-4e23-9d78-46bae65750f1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031327 May 16 17:44:03.990943 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 271/519] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:44:04.102099 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-7ef0e16e-2608-47e8-b60f-a1176db73864 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:04.107396 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-7ef0e16e-2608-47e8-b60f-a1176db73864 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1366 microversion: 2.1 time: 0.160995 May 16 17:44:04.108580 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 249/520] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:03 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:04.277120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-7cda9cd5-e4d7-4e14-b4a5-c8b33db9266f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:04.278556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-7cda9cd5-e4d7-4e14-b4a5-c8b33db9266f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:04.284827 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7cda9cd5-e4d7-4e14-b4a5-c8b33db9266f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:04.285271 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7cda9cd5-e4d7-4e14-b4a5-c8b33db9266f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:04.286073 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7cda9cd5-e4d7-4e14-b4a5-c8b33db9266f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:04.286486 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7cda9cd5-e4d7-4e14-b4a5-c8b33db9266f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:04.488570 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-7cda9cd5-e4d7-4e14-b4a5-c8b33db9266f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:04.498338 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-7cda9cd5-e4d7-4e14-b4a5-c8b33db9266f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1735 microversion: 2.1 time: 0.225765 May 16 17:44:04.499493 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 272/521] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:04 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:04.970392 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-7f042e69-a900-4b3b-9ddc-27772fc338fa tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2146891402"}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:44:04.970929 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-7f042e69-a900-4b3b-9ddc-27772fc338fa tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:04.977586 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7f042e69-a900-4b3b-9ddc-27772fc338fa tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:04.978262 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7f042e69-a900-4b3b-9ddc-27772fc338fa tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:04.979053 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7f042e69-a900-4b3b-9ddc-27772fc338fa tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:04.979479 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7f042e69-a900-4b3b-9ddc-27772fc338fa tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:05.109853 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.network.security_group_api [None req-7f042e69-a900-4b3b-9ddc-27772fc338fa tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Adding security group 1b88c01b-7f15-4181-b815-3a895a7d0309 to port aa1eb09f-24cd-4a34-b6e7-2d41f1534a63 May 16 17:44:05.124656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-480cd8a5-3a87-49b5-b32b-6ab3d3faacce tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:05.125264 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-480cd8a5-3a87-49b5-b32b-6ab3d3faacce tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:05.133270 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-480cd8a5-3a87-49b5-b32b-6ab3d3faacce tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:05.133884 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-480cd8a5-3a87-49b5-b32b-6ab3d3faacce tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:05.134529 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-480cd8a5-3a87-49b5-b32b-6ab3d3faacce tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:05.134959 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-480cd8a5-3a87-49b5-b32b-6ab3d3faacce tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:05.704774 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-480cd8a5-3a87-49b5-b32b-6ab3d3faacce tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:05.712838 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-480cd8a5-3a87-49b5-b32b-6ab3d3faacce tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1366 microversion: 2.1 time: 0.592293 May 16 17:44:05.713416 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 273/522] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:05 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1366 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:44:05.718027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-6e09d0c0-60f8-4518-81dd-00538f9a7563 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:05.718616 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-6e09d0c0-60f8-4518-81dd-00538f9a7563 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:05.724288 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6e09d0c0-60f8-4518-81dd-00538f9a7563 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:05.724731 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6e09d0c0-60f8-4518-81dd-00538f9a7563 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:05.725472 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6e09d0c0-60f8-4518-81dd-00538f9a7563 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:05.725928 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6e09d0c0-60f8-4518-81dd-00538f9a7563 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:05.939494 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-6e09d0c0-60f8-4518-81dd-00538f9a7563 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:05.947773 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-6e09d0c0-60f8-4518-81dd-00538f9a7563 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1735 microversion: 2.1 time: 0.233378 May 16 17:44:05.948555 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 274/523] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:05 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1735 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:06.018029 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-7f042e69-a900-4b3b-9ddc-27772fc338fa tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "POST /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9/action" status: 202 len: 0 microversion: 2.1 time: 1.051447 May 16 17:44:06.024111 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 250/524] 10.222.0.58 () {60 vars in 1277 bytes} [Mon May 16 17:44:04 2022] POST /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9/action => generated 0 bytes in 1058 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:44:06.027983 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-197a830c-1fb0-49dd-b636-184500c13aa4 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:06.028866 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-197a830c-1fb0-49dd-b636-184500c13aa4 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:06.029241 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-ae40fffb-8e56-4fb1-9ced-9e437459066e req-f525b6fc-7a8f-4646-aa6a-3364c3c4e1d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1928d55-33be-43a7-9d30-fcee59478af9", "tag": "aa1eb09f-24cd-4a34-b6e7-2d41f1534a63"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:44:06.041939 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-ae40fffb-8e56-4fb1-9ced-9e437459066e req-f525b6fc-7a8f-4646-aa6a-3364c3c4e1d9 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:06.042745 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-ae40fffb-8e56-4fb1-9ced-9e437459066e req-f525b6fc-7a8f-4646-aa6a-3364c3c4e1d9 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:06.042998 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-197a830c-1fb0-49dd-b636-184500c13aa4 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:06.043675 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-197a830c-1fb0-49dd-b636-184500c13aa4 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:06.044771 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-197a830c-1fb0-49dd-b636-184500c13aa4 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:06.045417 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-197a830c-1fb0-49dd-b636-184500c13aa4 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:06.068787 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-ae40fffb-8e56-4fb1-9ced-9e437459066e req-f525b6fc-7a8f-4646-aa6a-3364c3c4e1d9 service nova] Creating event network-changed:aa1eb09f-24cd-4a34-b6e7-2d41f1534a63 for instance e1928d55-33be-43a7-9d30-fcee59478af9 on hv-cinder-83769 May 16 17:44:06.074751 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-ae40fffb-8e56-4fb1-9ced-9e437459066e req-f525b6fc-7a8f-4646-aa6a-3364c3c4e1d9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049289 May 16 17:44:06.075339 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 251/525] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:44:06.295323 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-197a830c-1fb0-49dd-b636-184500c13aa4 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:06.304275 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-197a830c-1fb0-49dd-b636-184500c13aa4 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1640 microversion: 2.1 time: 0.280164 May 16 17:44:06.304868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 275/526] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:06 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1640 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:06.730244 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a19a0945-5ea9-4fcf-9aa9-715adda99f06 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:06.730994 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a19a0945-5ea9-4fcf-9aa9-715adda99f06 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:06.737131 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a19a0945-5ea9-4fcf-9aa9-715adda99f06 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:06.737625 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a19a0945-5ea9-4fcf-9aa9-715adda99f06 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:06.738375 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a19a0945-5ea9-4fcf-9aa9-715adda99f06 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:06.738799 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a19a0945-5ea9-4fcf-9aa9-715adda99f06 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:06.880647 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-a19a0945-5ea9-4fcf-9aa9-715adda99f06 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:06.888512 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a19a0945-5ea9-4fcf-9aa9-715adda99f06 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1556 microversion: 2.1 time: 0.162424 May 16 17:44:06.889080 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 252/527] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:06 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:06.904546 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-35b5da5c-fbe9-4f7e-82df-8753c2e30fb3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:06.905088 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-35b5da5c-fbe9-4f7e-82df-8753c2e30fb3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:06.911737 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-35b5da5c-fbe9-4f7e-82df-8753c2e30fb3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:06.912185 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-35b5da5c-fbe9-4f7e-82df-8753c2e30fb3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:06.912979 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-35b5da5c-fbe9-4f7e-82df-8753c2e30fb3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:06.913401 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-35b5da5c-fbe9-4f7e-82df-8753c2e30fb3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:06.965353 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9c1c8368-476f-4221-8067-d18fc7af30ab tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:06.966011 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-9c1c8368-476f-4221-8067-d18fc7af30ab tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:06.972166 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9c1c8368-476f-4221-8067-d18fc7af30ab tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:06.972611 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9c1c8368-476f-4221-8067-d18fc7af30ab tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:06.973378 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9c1c8368-476f-4221-8067-d18fc7af30ab tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:06.973829 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9c1c8368-476f-4221-8067-d18fc7af30ab tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:06.992133 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-35b5da5c-fbe9-4f7e-82df-8753c2e30fb3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091438 May 16 17:44:06.992730 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 276/528] 10.222.0.58 () {58 vars in 1274 bytes} [Mon May 16 17:44:06 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:44:07.252329 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9c1c8368-476f-4221-8067-d18fc7af30ab tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:07.262116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-9c1c8368-476f-4221-8067-d18fc7af30ab tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1735 microversion: 2.1 time: 0.301082 May 16 17:44:07.271738 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 253/529] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:06 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1735 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:44:08.279837 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-44275c45-3b57-4292-b95c-4f950dcaa41a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:08.280418 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-44275c45-3b57-4292-b95c-4f950dcaa41a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:08.287191 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-44275c45-3b57-4292-b95c-4f950dcaa41a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:08.287552 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-44275c45-3b57-4292-b95c-4f950dcaa41a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:08.288322 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-44275c45-3b57-4292-b95c-4f950dcaa41a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:08.288747 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-44275c45-3b57-4292-b95c-4f950dcaa41a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:08.675117 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-44275c45-3b57-4292-b95c-4f950dcaa41a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:08.683554 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-44275c45-3b57-4292-b95c-4f950dcaa41a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1735 microversion: 2.1 time: 0.408013 May 16 17:44:08.684223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 277/530] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:08 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1735 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:08.791240 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-72e3ff99-ad58-4c0d-ac17-81b87851fbb8 req-affdbb6f-c49e-46bf-a8ee-ea68e5c378af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f2449e-7706-405a-9dc2-3c52e3df0489", "tag": "36a356f3-2d74-47dd-9eae-4601aa39ccb1"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:44:08.800020 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-72e3ff99-ad58-4c0d-ac17-81b87851fbb8 req-affdbb6f-c49e-46bf-a8ee-ea68e5c378af service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:08.800460 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-72e3ff99-ad58-4c0d-ac17-81b87851fbb8 req-affdbb6f-c49e-46bf-a8ee-ea68e5c378af service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:08.811772 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-72e3ff99-ad58-4c0d-ac17-81b87851fbb8 req-affdbb6f-c49e-46bf-a8ee-ea68e5c378af service nova] Creating event network-changed:36a356f3-2d74-47dd-9eae-4601aa39ccb1 for instance 10f2449e-7706-405a-9dc2-3c52e3df0489 on hv-cinder-83769 May 16 17:44:08.816788 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-72e3ff99-ad58-4c0d-ac17-81b87851fbb8 req-affdbb6f-c49e-46bf-a8ee-ea68e5c378af service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029246 May 16 17:44:08.817507 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 254/531] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:44:08.922681 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-9f7b2adf-fde0-4c99-99d0-edd35595944e tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:08.923230 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-9f7b2adf-fde0-4c99-99d0-edd35595944e tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:08.929747 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9f7b2adf-fde0-4c99-99d0-edd35595944e tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:08.930201 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9f7b2adf-fde0-4c99-99d0-edd35595944e tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:08.930975 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9f7b2adf-fde0-4c99-99d0-edd35595944e tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:08.931412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9f7b2adf-fde0-4c99-99d0-edd35595944e tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:09.014374 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.objects.instance [None req-9f7b2adf-fde0-4c99-99d0-edd35595944e tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lazy-loading 'services' on Instance uuid 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 {{(pid=128815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:44:09.087264 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-9f7b2adf-fde0-4c99-99d0-edd35595944e tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6/os-volume_attachments/7f5bd68e-6648-48aa-bbfe-6b20e4596e58" status: 202 len: 0 microversion: 2.1 time: 0.168355 May 16 17:44:09.087864 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 278/532] 10.222.0.58 () {58 vars in 1415 bytes} [Mon May 16 17:44:08 2022] DELETE /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6/os-volume_attachments/7f5bd68e-6648-48aa-bbfe-6b20e4596e58 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:44:09.706734 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e5498eae-e023-439f-9be4-407fe8368a83 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:09.707483 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e5498eae-e023-439f-9be4-407fe8368a83 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:09.717759 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e5498eae-e023-439f-9be4-407fe8368a83 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:09.718202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e5498eae-e023-439f-9be4-407fe8368a83 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:09.719243 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e5498eae-e023-439f-9be4-407fe8368a83 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:09.719861 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e5498eae-e023-439f-9be4-407fe8368a83 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:09.903620 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e5498eae-e023-439f-9be4-407fe8368a83 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:09.914448 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e5498eae-e023-439f-9be4-407fe8368a83 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1715 microversion: 2.1 time: 0.211947 May 16 17:44:09.915215 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 255/533] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:09 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1715 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:10.031429 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-bd09d756-259b-4b3b-8d7c-535aab191d9a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:10.031981 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-bd09d756-259b-4b3b-8d7c-535aab191d9a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:10.038320 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bd09d756-259b-4b3b-8d7c-535aab191d9a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:10.038786 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bd09d756-259b-4b3b-8d7c-535aab191d9a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:10.039550 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bd09d756-259b-4b3b-8d7c-535aab191d9a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:10.039983 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bd09d756-259b-4b3b-8d7c-535aab191d9a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:10.122232 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-bd09d756-259b-4b3b-8d7c-535aab191d9a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] HTTP exception thrown: Cannot 'detach_volume' instance ae780970-4212-46bc-8038-69067eb4e039 while it is in vm_state rescued May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-bd09d756-259b-4b3b-8d7c-535aab191d9a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Request method failure captured: May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: DELETE /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-volume_attachments/20c7aac5-4970-47e1-a405-fa325a327c54 HTTP/1.1 May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigox3Qmb4992kn72mY0kZabi3WWaMoKtsNJ81h1vGTu6lqq_JffhZxwNoadReBgNHMCVOBH4NrH9XXgD7nYDL--nkddztfIg0jyy7tVCW5L3LondFz79JY-50aJZtbJok48vYOP6Nqc0oTFz5yi_gn8jJF0uyZpp_zS0drwvaV5rtuvk May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 1eddf9ae85b940b8bd556f4cf66c0b79 May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1737598232 May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:44:10.123907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:44:10.125404 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eddf9ae85b940b8bd556f4cf66c0b79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1eddf9ae85b940b8bd556f4cf66c0b79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1eddf9ae85b940b8bd556f4cf66c0b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eddf9ae85b940b8bd556f4cf66c0b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:44:10.125404 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1737598232 May 16 17:44:10.125404 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 1eddf9ae85b940b8bd556f4cf66c0b79 May 16 17:44:10.125404 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1737598232 May 16 17:44:10.125404 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-ServerRescueNegativeTestJSON-1737598232-project May 16 17:44:10.125404 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:44:10.125404 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:44:10.125404 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: c482d82afb734e10a5a11070fcb5f736 May 16 17:44:10.125404 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1737598232-project May 16 17:44:10.125404 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:44:10.125404 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Cannot 'detach_volume' instance ae780970-4212-46bc-8038-69067eb4e039 while it is in vm_state rescued May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'server_id': 'ae780970-4212-46bc-8038-69067eb4e039', 'id': '20c7aac5-4970-47e1-a405-fa325a327c54'} May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ae780970-4212-46bc-8038-69067eb4e039 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:44:10.126255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:44:10.127738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 16 17:44:10.127738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 16 17:44:10.127738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 16 17:44:10.127738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 16 17:44:10.127738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ae780970-4212-46bc-8038-69067eb4e039 while it is in vm_state rescued May 16 17:44:10.127738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:44:10.127738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:44:10.127738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:44:10.127738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:44:10.127738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:44:10.127738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:44:10.127738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:44:10.127738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:44:10.127738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ae780970-4212-46bc-8038-69067eb4e039 while it is in vm_state rescued May 16 17:44:10.127738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:44:10.127738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-bd09d756-259b-4b3b-8d7c-535aab191d9a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Returning 409 to user: Cannot 'detach_volume' instance ae780970-4212-46bc-8038-69067eb4e039 while it is in vm_state rescued {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:44:10.128902 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-bd09d756-259b-4b3b-8d7c-535aab191d9a tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-volume_attachments/20c7aac5-4970-47e1-a405-fa325a327c54" status: 409 len: 152 microversion: 2.1 time: 0.098873 May 16 17:44:10.128902 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 279/534] 10.222.0.58 () {58 vars in 1415 bytes} [Mon May 16 17:44:10 2022] DELETE /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-volume_attachments/20c7aac5-4970-47e1-a405-fa325a327c54 => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 16 17:44:10.134735 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-237c60cf-3f17-4bf3-985f-00120b1cc9e2 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:44:10.135268 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-237c60cf-3f17-4bf3-985f-00120b1cc9e2 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:10.141658 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-237c60cf-3f17-4bf3-985f-00120b1cc9e2 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:10.142112 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-237c60cf-3f17-4bf3-985f-00120b1cc9e2 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:10.142888 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-237c60cf-3f17-4bf3-985f-00120b1cc9e2 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:10.143322 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-237c60cf-3f17-4bf3-985f-00120b1cc9e2 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:10.227505 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-237c60cf-3f17-4bf3-985f-00120b1cc9e2 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "POST /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/action" status: 202 len: 0 microversion: 2.1 time: 0.096694 May 16 17:44:10.229579 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 256/535] 10.222.0.58 () {60 vars in 1277 bytes} [Mon May 16 17:44:10 2022] POST /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:44:10.236406 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-89798ae5-fa07-4e06-9ba9-484a6929c325 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:10.237021 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-89798ae5-fa07-4e06-9ba9-484a6929c325 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:10.243128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-89798ae5-fa07-4e06-9ba9-484a6929c325 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:10.243579 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-89798ae5-fa07-4e06-9ba9-484a6929c325 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:10.244354 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-89798ae5-fa07-4e06-9ba9-484a6929c325 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:10.244787 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-89798ae5-fa07-4e06-9ba9-484a6929c325 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:10.520406 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-89798ae5-fa07-4e06-9ba9-484a6929c325 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:10.537397 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-89798ae5-fa07-4e06-9ba9-484a6929c325 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1723 microversion: 2.1 time: 0.304767 May 16 17:44:10.545487 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 280/536] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:10 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1723 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:11.272032 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-60e1fdad-06d1-4dfb-8203-22b58e1be521 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:11.272610 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-60e1fdad-06d1-4dfb-8203-22b58e1be521 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:11.282095 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-60e1fdad-06d1-4dfb-8203-22b58e1be521 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:11.282544 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-60e1fdad-06d1-4dfb-8203-22b58e1be521 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:11.283352 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-60e1fdad-06d1-4dfb-8203-22b58e1be521 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:11.283788 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-60e1fdad-06d1-4dfb-8203-22b58e1be521 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:11.310698 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-60e1fdad-06d1-4dfb-8203-22b58e1be521 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Going to try to terminate instance {{(pid=128816) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:44:11.392451 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-60e1fdad-06d1-4dfb-8203-22b58e1be521 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6" status: 204 len: 0 microversion: 2.1 time: 0.124662 May 16 17:44:11.393052 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 257/537] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:44:11 2022] DELETE /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:44:11.401299 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-1ad23ede-3d36-41fa-b4b7-3d580cc367d5 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:11.401935 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-1ad23ede-3d36-41fa-b4b7-3d580cc367d5 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:11.409912 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1ad23ede-3d36-41fa-b4b7-3d580cc367d5 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:11.410369 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1ad23ede-3d36-41fa-b4b7-3d580cc367d5 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:11.411134 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1ad23ede-3d36-41fa-b4b7-3d580cc367d5 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:11.411585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1ad23ede-3d36-41fa-b4b7-3d580cc367d5 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:11.548440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-1ad23ede-3d36-41fa-b4b7-3d580cc367d5 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:11.556371 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-5adb51cc-c12c-48cb-8844-4061acc0a6d5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:11.556692 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-1ad23ede-3d36-41fa-b4b7-3d580cc367d5 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6" status: 200 len: 1513 microversion: 2.1 time: 0.159250 May 16 17:44:11.557091 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-5adb51cc-c12c-48cb-8844-4061acc0a6d5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:11.558791 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 281/538] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:11 2022] GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:11.566639 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5adb51cc-c12c-48cb-8844-4061acc0a6d5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:11.567105 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5adb51cc-c12c-48cb-8844-4061acc0a6d5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:11.568528 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5adb51cc-c12c-48cb-8844-4061acc0a6d5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:11.568528 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5adb51cc-c12c-48cb-8844-4061acc0a6d5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:11.708846 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-5adb51cc-c12c-48cb-8844-4061acc0a6d5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:11.717170 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-5adb51cc-c12c-48cb-8844-4061acc0a6d5 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1723 microversion: 2.1 time: 0.165175 May 16 17:44:11.717768 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 258/539] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:11 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:12.574638 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-6aa73c30-981c-4b79-8387-6b4ce10f158f tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:12.575286 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-6aa73c30-981c-4b79-8387-6b4ce10f158f tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:12.582412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6aa73c30-981c-4b79-8387-6b4ce10f158f tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:12.582854 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6aa73c30-981c-4b79-8387-6b4ce10f158f tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:12.583619 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6aa73c30-981c-4b79-8387-6b4ce10f158f tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:12.584049 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6aa73c30-981c-4b79-8387-6b4ce10f158f tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:12.718457 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-6aa73c30-981c-4b79-8387-6b4ce10f158f tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:12.726832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-6aa73c30-981c-4b79-8387-6b4ce10f158f tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6" status: 200 len: 1513 microversion: 2.1 time: 0.156143 May 16 17:44:12.727396 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 282/540] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:12 2022] GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:12.734908 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-7a931641-1ed4-47ee-b610-d9b977c7f4df tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:12.735518 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-7a931641-1ed4-47ee-b610-d9b977c7f4df tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:12.744916 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7a931641-1ed4-47ee-b610-d9b977c7f4df tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:12.745619 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7a931641-1ed4-47ee-b610-d9b977c7f4df tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:12.746885 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7a931641-1ed4-47ee-b610-d9b977c7f4df tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:12.747494 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7a931641-1ed4-47ee-b610-d9b977c7f4df tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:12.884197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-7a931641-1ed4-47ee-b610-d9b977c7f4df tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:12.892822 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-7a931641-1ed4-47ee-b610-d9b977c7f4df tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1723 microversion: 2.1 time: 0.161881 May 16 17:44:12.893398 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 259/541] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:12 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:13.749067 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-c23df272-b13c-4d17-929c-2108d55234d7 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:13.750560 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-c23df272-b13c-4d17-929c-2108d55234d7 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:13.761111 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c23df272-b13c-4d17-929c-2108d55234d7 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:13.762364 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c23df272-b13c-4d17-929c-2108d55234d7 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:13.763319 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c23df272-b13c-4d17-929c-2108d55234d7 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:13.763756 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c23df272-b13c-4d17-929c-2108d55234d7 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:13.908921 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-c23df272-b13c-4d17-929c-2108d55234d7 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:13.912896 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-66a47fea-faee-4d9a-bacb-ce97a76d2b6e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:13.913514 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-66a47fea-faee-4d9a-bacb-ce97a76d2b6e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:13.920753 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-c23df272-b13c-4d17-929c-2108d55234d7 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6" status: 200 len: 1513 microversion: 2.1 time: 0.178323 May 16 17:44:13.921877 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 283/542] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:13 2022] GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:13.924025 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-66a47fea-faee-4d9a-bacb-ce97a76d2b6e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:13.925151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-66a47fea-faee-4d9a-bacb-ce97a76d2b6e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:13.926596 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-66a47fea-faee-4d9a-bacb-ce97a76d2b6e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:13.927600 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-66a47fea-faee-4d9a-bacb-ce97a76d2b6e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:14.065504 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-66a47fea-faee-4d9a-bacb-ce97a76d2b6e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:14.073962 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-66a47fea-faee-4d9a-bacb-ce97a76d2b6e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1723 microversion: 2.1 time: 0.167219 May 16 17:44:14.074535 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 260/543] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:13 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:14.942510 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-a95c2262-10bf-4812-9c34-1a9974273bcd tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:14.943392 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a95c2262-10bf-4812-9c34-1a9974273bcd tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:14.949996 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a95c2262-10bf-4812-9c34-1a9974273bcd tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:14.950448 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a95c2262-10bf-4812-9c34-1a9974273bcd tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:14.951227 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a95c2262-10bf-4812-9c34-1a9974273bcd tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:14.951660 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a95c2262-10bf-4812-9c34-1a9974273bcd tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:15.014796 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-a95c2262-10bf-4812-9c34-1a9974273bcd tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:15.022951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-a95c2262-10bf-4812-9c34-1a9974273bcd tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6" status: 200 len: 1471 microversion: 2.1 time: 0.084279 May 16 17:44:15.023251 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 284/544] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:14 2022] GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 => generated 1471 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:15.076289 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-02423740-a467-4336-9c43-5af927169a79 req-614ab1fe-2d18-4af6-8e92-44aabafe869c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2c4e36-c99c-4e7e-8d51-3c718392f0a6", "name": "network-vif-deleted", "tag": "5a11f1e6-ee0e-4119-a8ac-18053bc731e5"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:44:15.087864 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-02423740-a467-4336-9c43-5af927169a79 req-614ab1fe-2d18-4af6-8e92-44aabafe869c service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:15.088320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-02423740-a467-4336-9c43-5af927169a79 req-614ab1fe-2d18-4af6-8e92-44aabafe869c service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:15.091154 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ba7e0d0d-822b-4a7d-81fe-4fbf5ac1e4e8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:15.091874 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ba7e0d0d-822b-4a7d-81fe-4fbf5ac1e4e8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:15.098292 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ba7e0d0d-822b-4a7d-81fe-4fbf5ac1e4e8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:15.098776 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ba7e0d0d-822b-4a7d-81fe-4fbf5ac1e4e8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:15.099619 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ba7e0d0d-822b-4a7d-81fe-4fbf5ac1e4e8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:15.100069 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ba7e0d0d-822b-4a7d-81fe-4fbf5ac1e4e8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:15.100966 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-02423740-a467-4336-9c43-5af927169a79 req-614ab1fe-2d18-4af6-8e92-44aabafe869c service nova] Creating event network-vif-deleted:5a11f1e6-ee0e-4119-a8ac-18053bc731e5 for instance 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 on hv-cinder-83769 May 16 17:44:15.107897 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-02423740-a467-4336-9c43-5af927169a79 req-614ab1fe-2d18-4af6-8e92-44aabafe869c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035620 May 16 17:44:15.108626 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 261/545] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:44:15.244099 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ba7e0d0d-822b-4a7d-81fe-4fbf5ac1e4e8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:15.252119 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ba7e0d0d-822b-4a7d-81fe-4fbf5ac1e4e8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1729 microversion: 2.1 time: 0.165133 May 16 17:44:15.252647 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 285/546] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:15 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:44:15.268896 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d8019102-243c-44a5-b7ef-b1d5c91b3970 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:15.269452 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d8019102-243c-44a5-b7ef-b1d5c91b3970 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:15.275656 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d8019102-243c-44a5-b7ef-b1d5c91b3970 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:15.276114 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d8019102-243c-44a5-b7ef-b1d5c91b3970 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:15.276875 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d8019102-243c-44a5-b7ef-b1d5c91b3970 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:15.277308 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d8019102-243c-44a5-b7ef-b1d5c91b3970 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:15.353119 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d8019102-243c-44a5-b7ef-b1d5c91b3970 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088412 May 16 17:44:15.353752 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 262/547] 10.222.0.58 () {58 vars in 1274 bytes} [Mon May 16 17:44:15 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:44:16.039855 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-67a92b0b-a170-4a42-99c7-2e38f848cd8a tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:16.040474 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-67a92b0b-a170-4a42-99c7-2e38f848cd8a tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:16.047715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-67a92b0b-a170-4a42-99c7-2e38f848cd8a tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:16.048178 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-67a92b0b-a170-4a42-99c7-2e38f848cd8a tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:16.048901 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-67a92b0b-a170-4a42-99c7-2e38f848cd8a tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:16.049363 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-67a92b0b-a170-4a42-99c7-2e38f848cd8a tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:16.064090 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-67a92b0b-a170-4a42-99c7-2e38f848cd8a tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] HTTP exception thrown: Instance 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 could not be found. May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-67a92b0b-a170-4a42-99c7-2e38f848cd8a tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Request method failure captured: May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 HTTP/1.1 May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigo0r_wgJiXkhMp5zepBpGGuEIcxUonfLRMoyqEXGsSDV-XVFIssW8NH9Sxq1d0iaK5eRMadzmWQvDeGKy1dFqfk1hw9jO6s-CACYLhXESImLVGUBdRoCtmdoLOxL2ZHSeIPqdqkDJrIeraJGaJ74DlhntxFCzhwxoK6Luo3CuwmklN8 May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 8e740d27d929404fbc7a4964dab899d0 May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1499934369 May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:44:16.065889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:44:16.067449 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e740d27d929404fbc7a4964dab899d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8e740d27d929404fbc7a4964dab899d0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8e740d27d929404fbc7a4964dab899d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e740d27d929404fbc7a4964dab899d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:44:16.067449 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-VolumesSnapshotTestJSON-1499934369 May 16 17:44:16.067449 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 8e740d27d929404fbc7a4964dab899d0 May 16 17:44:16.067449 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1499934369 May 16 17:44:16.067449 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-VolumesSnapshotTestJSON-1499934369-project May 16 17:44:16.067449 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:44:16.067449 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:44:16.067449 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: ad9e1d2049fa4330b1f78692e9ab7b10 May 16 17:44:16.067449 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-VolumesSnapshotTestJSON-1499934369-project May 16 17:44:16.067449 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:44:16.067449 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 could not be found. May 16 17:44:16.067449 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': '6a2c4e36-c99c-4e7e-8d51-3c718392f0a6'} May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 could not be found. May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:44:16.068419 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:44:16.073629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:44:16.073629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:44:16.073629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:44:16.073629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:44:16.073629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:44:16.073629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:44:16.073629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:44:16.073629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 could not be found. May 16 17:44:16.073629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:44:16.073629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:44:16.073629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:44:16.073629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:44:16.073629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:44:16.073629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:44:16.073629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:44:16.073629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:44:16.073629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 could not be found. May 16 17:44:16.073629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:44:16.074920 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-67a92b0b-a170-4a42-99c7-2e38f848cd8a tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Returning 404 to user: Instance 6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:44:16.074920 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-67a92b0b-a170-4a42-99c7-2e38f848cd8a tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6" status: 404 len: 111 microversion: 2.1 time: 0.032032 May 16 17:44:16.074920 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 286/548] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:16 2022] GET /compute/v2.1/servers/6a2c4e36-c99c-4e7e-8d51-3c718392f0a6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:44:16.478770 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-3f89ae63-ec6d-4926-9544-bfc28d44a39a req-598f93d0-1873-4e61-b64e-6f6aaf4e6934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae780970-4212-46bc-8038-69067eb4e039", "tag": "5942e31d-ecd1-4f97-9d8e-c38cb2323490"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:44:16.488046 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-3f89ae63-ec6d-4926-9544-bfc28d44a39a req-598f93d0-1873-4e61-b64e-6f6aaf4e6934 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:16.488485 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-3f89ae63-ec6d-4926-9544-bfc28d44a39a req-598f93d0-1873-4e61-b64e-6f6aaf4e6934 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:16.500845 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-3f89ae63-ec6d-4926-9544-bfc28d44a39a req-598f93d0-1873-4e61-b64e-6f6aaf4e6934 service nova] Creating event network-changed:5942e31d-ecd1-4f97-9d8e-c38cb2323490 for instance ae780970-4212-46bc-8038-69067eb4e039 on hv-cinder-83769 May 16 17:44:16.506527 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-3f89ae63-ec6d-4926-9544-bfc28d44a39a req-598f93d0-1873-4e61-b64e-6f6aaf4e6934 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031962 May 16 17:44:16.507216 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 263/549] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:44:18.526549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-200a1931-409c-477c-8e67-4eb1ce501509 req-c2a78dce-98ac-4529-b950-256f47c78ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae780970-4212-46bc-8038-69067eb4e039", "tag": "5942e31d-ecd1-4f97-9d8e-c38cb2323490"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:44:18.536478 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-200a1931-409c-477c-8e67-4eb1ce501509 req-c2a78dce-98ac-4529-b950-256f47c78ff2 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:18.537205 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-200a1931-409c-477c-8e67-4eb1ce501509 req-c2a78dce-98ac-4529-b950-256f47c78ff2 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:18.548410 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-200a1931-409c-477c-8e67-4eb1ce501509 req-c2a78dce-98ac-4529-b950-256f47c78ff2 service nova] Creating event network-changed:5942e31d-ecd1-4f97-9d8e-c38cb2323490 for instance ae780970-4212-46bc-8038-69067eb4e039 on hv-cinder-83769 May 16 17:44:18.554263 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-200a1931-409c-477c-8e67-4eb1ce501509 req-c2a78dce-98ac-4529-b950-256f47c78ff2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033287 May 16 17:44:18.555042 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 287/550] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:44:24.931032 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-212d6cfa-4606-4999-a754-9b2c3adf4ffe tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-199467388", "imageRef": "782bd628-ef1b-419c-99f5-2c312d1766a6", "flavorRef": "452", "networks": [{"uuid": "9f93a893-0813-4415-8e02-fac7fa54db24"}]}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:44:24.981685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.network.neutron [None req-212d6cfa-4606-4999-a754-9b2c3adf4ffe tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] validate_networks() for [('9f93a893-0813-4415-8e02-fac7fa54db24', None, None, None, None, None)] {{(pid=128816) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:44:25.334341 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-212d6cfa-4606-4999-a754-9b2c3adf4ffe tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Flavor limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:44:25.334760 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-212d6cfa-4606-4999-a754-9b2c3adf4ffe tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Image limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:44:25.335235 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-212d6cfa-4606-4999-a754-9b2c3adf4ffe tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Flavor pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:44:25.335640 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-212d6cfa-4606-4999-a754-9b2c3adf4ffe tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Image pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:44:25.336053 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-212d6cfa-4606-4999-a754-9b2c3adf4ffe tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:44:25.346128 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-212d6cfa-4606-4999-a754-9b2c3adf4ffe tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:25.346572 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-212d6cfa-4606-4999-a754-9b2c3adf4ffe tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:25.347377 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-212d6cfa-4606-4999-a754-9b2c3adf4ffe tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:25.347807 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-212d6cfa-4606-4999-a754-9b2c3adf4ffe tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:25.364841 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-212d6cfa-4606-4999-a754-9b2c3adf4ffe tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Getting quotas for project 8e740d27d929404fbc7a4964dab899d0. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:44:25.368916 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-212d6cfa-4606-4999-a754-9b2c3adf4ffe tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Getting quotas for user ad9e1d2049fa4330b1f78692e9ab7b10 and project 8e740d27d929404fbc7a4964dab899d0. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:44:25.380769 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-212d6cfa-4606-4999-a754-9b2c3adf4ffe tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Going to run 1 instances... {{(pid=128816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:44:25.383132 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-212d6cfa-4606-4999-a754-9b2c3adf4ffe tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='782bd628-ef1b-419c-99f5-2c312d1766a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:44:25.426870 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-212d6cfa-4606-4999-a754-9b2c3adf4ffe tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500867 May 16 17:44:25.427710 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 264/551] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:44:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:44:25.438330 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-148804ae-e580-4fc3-9e1a-90108ab325de tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:25.439154 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-148804ae-e580-4fc3-9e1a-90108ab325de tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:25.494363 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-148804ae-e580-4fc3-9e1a-90108ab325de tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:25.501677 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-148804ae-e580-4fc3-9e1a-90108ab325de tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9" status: 200 len: 1218 microversion: 2.1 time: 0.067366 May 16 17:44:25.502549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 288/552] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:25 2022] GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:26.520343 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-1eba8dc8-5a7d-4a34-86de-4c1bf14400d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:26.520954 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-1eba8dc8-5a7d-4a34-86de-4c1bf14400d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:26.528601 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1eba8dc8-5a7d-4a34-86de-4c1bf14400d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:26.529077 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1eba8dc8-5a7d-4a34-86de-4c1bf14400d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:26.529879 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1eba8dc8-5a7d-4a34-86de-4c1bf14400d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:26.530518 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1eba8dc8-5a7d-4a34-86de-4c1bf14400d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:26.597759 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-1eba8dc8-5a7d-4a34-86de-4c1bf14400d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:26.606535 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-1eba8dc8-5a7d-4a34-86de-4c1bf14400d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9" status: 200 len: 1288 microversion: 2.1 time: 0.091410 May 16 17:44:26.607560 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 265/553] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:26 2022] GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9 => generated 1288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:27.625243 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-769817cb-e4de-4c2b-a2bd-270565a696db tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:27.625870 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-769817cb-e4de-4c2b-a2bd-270565a696db tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:27.634072 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-769817cb-e4de-4c2b-a2bd-270565a696db tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:27.634537 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-769817cb-e4de-4c2b-a2bd-270565a696db tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:27.635319 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-769817cb-e4de-4c2b-a2bd-270565a696db tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:27.635743 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-769817cb-e4de-4c2b-a2bd-270565a696db tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:27.769336 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-769817cb-e4de-4c2b-a2bd-270565a696db tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:27.776810 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-769817cb-e4de-4c2b-a2bd-270565a696db tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9" status: 200 len: 1318 microversion: 2.1 time: 0.156213 May 16 17:44:27.777394 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 289/554] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:27 2022] GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:28.004891 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-f736210e-6091-4132-a020-0c9ee814d09e req-fcdf9fd2-f24e-483d-ae4b-f4146b1712dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6338a689-ab4a-4936-93e3-a225bce4f5f9", "tag": "3fcae629-8202-4a66-ae4b-06c3c7cfddfc"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:44:28.016880 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-f736210e-6091-4132-a020-0c9ee814d09e req-fcdf9fd2-f24e-483d-ae4b-f4146b1712dd service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:28.017307 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-f736210e-6091-4132-a020-0c9ee814d09e req-fcdf9fd2-f24e-483d-ae4b-f4146b1712dd service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:28.032605 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-f736210e-6091-4132-a020-0c9ee814d09e req-fcdf9fd2-f24e-483d-ae4b-f4146b1712dd service nova] Creating event network-changed:3fcae629-8202-4a66-ae4b-06c3c7cfddfc for instance 6338a689-ab4a-4936-93e3-a225bce4f5f9 on hv-cinder-83769 May 16 17:44:28.037603 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-f736210e-6091-4132-a020-0c9ee814d09e req-fcdf9fd2-f24e-483d-ae4b-f4146b1712dd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036526 May 16 17:44:28.038514 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 266/555] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:44:28.798563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-eb6187e6-0909-4ee1-bf49-2813cda3222a tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:28.799515 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-eb6187e6-0909-4ee1-bf49-2813cda3222a tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:28.810519 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-eb6187e6-0909-4ee1-bf49-2813cda3222a tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:28.811274 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-eb6187e6-0909-4ee1-bf49-2813cda3222a tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:28.812525 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-eb6187e6-0909-4ee1-bf49-2813cda3222a tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:28.813249 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-eb6187e6-0909-4ee1-bf49-2813cda3222a tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:28.954995 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-eb6187e6-0909-4ee1-bf49-2813cda3222a tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:28.962473 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-eb6187e6-0909-4ee1-bf49-2813cda3222a tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9" status: 200 len: 1318 microversion: 2.1 time: 0.170862 May 16 17:44:28.963048 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 290/556] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:28 2022] GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:29.980009 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-bab1b29d-507b-43f1-9229-b7490176cddf tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:29.980705 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-bab1b29d-507b-43f1-9229-b7490176cddf tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:29.987793 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bab1b29d-507b-43f1-9229-b7490176cddf tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:29.988241 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bab1b29d-507b-43f1-9229-b7490176cddf tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:29.989020 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bab1b29d-507b-43f1-9229-b7490176cddf tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:29.989450 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bab1b29d-507b-43f1-9229-b7490176cddf tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:30.128851 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-bab1b29d-507b-43f1-9229-b7490176cddf tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:30.141116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-bab1b29d-507b-43f1-9229-b7490176cddf tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9" status: 200 len: 1318 microversion: 2.1 time: 0.165411 May 16 17:44:30.141708 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 267/557] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:29 2022] GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:31.163577 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-b8a1f23e-7240-4827-849c-79962349a0d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:31.164688 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b8a1f23e-7240-4827-849c-79962349a0d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:31.175595 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b8a1f23e-7240-4827-849c-79962349a0d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:31.176325 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b8a1f23e-7240-4827-849c-79962349a0d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:31.177636 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b8a1f23e-7240-4827-849c-79962349a0d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:31.178423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b8a1f23e-7240-4827-849c-79962349a0d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:31.307578 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b8a1f23e-7240-4827-849c-79962349a0d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:31.315049 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-b8a1f23e-7240-4827-849c-79962349a0d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9" status: 200 len: 1318 microversion: 2.1 time: 0.158389 May 16 17:44:31.315631 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 291/558] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:31 2022] GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:32.336074 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-bcd3470a-e477-4a8e-800f-93a40f313b0c tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:32.336999 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-bcd3470a-e477-4a8e-800f-93a40f313b0c tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:32.347710 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bcd3470a-e477-4a8e-800f-93a40f313b0c tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:32.348452 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bcd3470a-e477-4a8e-800f-93a40f313b0c tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:32.349737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bcd3470a-e477-4a8e-800f-93a40f313b0c tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:32.350461 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bcd3470a-e477-4a8e-800f-93a40f313b0c tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:32.481167 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-bcd3470a-e477-4a8e-800f-93a40f313b0c tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:32.489472 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-bcd3470a-e477-4a8e-800f-93a40f313b0c tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9" status: 200 len: 1318 microversion: 2.1 time: 0.159940 May 16 17:44:32.490083 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 268/559] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:32 2022] GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:33.344394 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-a1f79141-ae1a-43cc-b852-09ef23cf44ca req-168f7a6a-1c73-4a80-9d26-4dd73450ed18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6338a689-ab4a-4936-93e3-a225bce4f5f9", "name": "network-vif-plugged", "status": "completed", "tag": "3fcae629-8202-4a66-ae4b-06c3c7cfddfc"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:44:33.353362 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-a1f79141-ae1a-43cc-b852-09ef23cf44ca req-168f7a6a-1c73-4a80-9d26-4dd73450ed18 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:33.353910 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-a1f79141-ae1a-43cc-b852-09ef23cf44ca req-168f7a6a-1c73-4a80-9d26-4dd73450ed18 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:33.365183 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-a1f79141-ae1a-43cc-b852-09ef23cf44ca req-168f7a6a-1c73-4a80-9d26-4dd73450ed18 service nova] Creating event network-vif-plugged:3fcae629-8202-4a66-ae4b-06c3c7cfddfc for instance 6338a689-ab4a-4936-93e3-a225bce4f5f9 on hv-cinder-83769 May 16 17:44:33.370096 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-a1f79141-ae1a-43cc-b852-09ef23cf44ca req-168f7a6a-1c73-4a80-9d26-4dd73450ed18 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029393 May 16 17:44:33.370693 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 292/560] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:44:33.506796 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-0e73be9e-cbb0-4005-bcd7-6af263ecb5f3 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:33.507443 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-0e73be9e-cbb0-4005-bcd7-6af263ecb5f3 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:33.514001 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0e73be9e-cbb0-4005-bcd7-6af263ecb5f3 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:33.514424 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0e73be9e-cbb0-4005-bcd7-6af263ecb5f3 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:33.515189 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0e73be9e-cbb0-4005-bcd7-6af263ecb5f3 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:33.515635 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0e73be9e-cbb0-4005-bcd7-6af263ecb5f3 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:33.646303 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-0e73be9e-cbb0-4005-bcd7-6af263ecb5f3 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:33.653826 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-0e73be9e-cbb0-4005-bcd7-6af263ecb5f3 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9" status: 200 len: 1318 microversion: 2.1 time: 0.151090 May 16 17:44:33.654398 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 269/561] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:33 2022] GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:34.677031 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d47d6cbd-8ea7-4ca3-8748-bc2231f476d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:34.678222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d47d6cbd-8ea7-4ca3-8748-bc2231f476d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:34.688823 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d47d6cbd-8ea7-4ca3-8748-bc2231f476d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:34.689598 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d47d6cbd-8ea7-4ca3-8748-bc2231f476d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:34.690951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d47d6cbd-8ea7-4ca3-8748-bc2231f476d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:34.691562 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d47d6cbd-8ea7-4ca3-8748-bc2231f476d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:34.826398 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d47d6cbd-8ea7-4ca3-8748-bc2231f476d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:34.834156 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d47d6cbd-8ea7-4ca3-8748-bc2231f476d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9" status: 200 len: 1318 microversion: 2.1 time: 0.164988 May 16 17:44:34.834702 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 293/562] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:34 2022] GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:35.855580 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-aa1f0d55-2205-4cab-be7c-7265c5fd97d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:35.856509 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-aa1f0d55-2205-4cab-be7c-7265c5fd97d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:35.867477 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-aa1f0d55-2205-4cab-be7c-7265c5fd97d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:35.868225 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-aa1f0d55-2205-4cab-be7c-7265c5fd97d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:35.869499 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-aa1f0d55-2205-4cab-be7c-7265c5fd97d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:35.870258 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-aa1f0d55-2205-4cab-be7c-7265c5fd97d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:36.014834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-aa1f0d55-2205-4cab-be7c-7265c5fd97d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:36.026093 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-aa1f0d55-2205-4cab-be7c-7265c5fd97d1 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9" status: 200 len: 1506 microversion: 2.1 time: 0.176914 May 16 17:44:36.026901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 270/563] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:35 2022] GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:36.043634 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0e47b5d2-ec22-42e8-aae3-ed9f1991b0d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c9e9d25-06de-4402-a81a-f88931d01842", "device": "/dev/sdb"}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:44:36.045215 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-0e47b5d2-ec22-42e8-aae3-ed9f1991b0d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:36.051744 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0e47b5d2-ec22-42e8-aae3-ed9f1991b0d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:36.052197 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0e47b5d2-ec22-42e8-aae3-ed9f1991b0d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:36.052958 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0e47b5d2-ec22-42e8-aae3-ed9f1991b0d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:36.053390 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0e47b5d2-ec22-42e8-aae3-ed9f1991b0d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:36.293361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-0e47b5d2-ec22-42e8-aae3-ed9f1991b0d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "POST /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253991 May 16 17:44:36.294016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 294/564] 10.222.0.58 () {60 vars in 1322 bytes} [Mon May 16 17:44:36 2022] POST /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:44:39.780040 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a3bae07c-5dea-426e-837f-970d97812507 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:44:39.781629 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a3bae07c-5dea-426e-837f-970d97812507 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:39.792053 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a3bae07c-5dea-426e-837f-970d97812507 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:39.792912 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a3bae07c-5dea-426e-837f-970d97812507 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:39.794026 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a3bae07c-5dea-426e-837f-970d97812507 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:39.794138 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a3bae07c-5dea-426e-837f-970d97812507 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:39.871117 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a3bae07c-5dea-426e-837f-970d97812507 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "POST /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9/action" status: 202 len: 0 microversion: 2.1 time: 0.097205 May 16 17:44:39.871742 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 271/565] 10.222.0.58 () {60 vars in 1277 bytes} [Mon May 16 17:44:39 2022] POST /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:44:39.880927 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d1cac563-7ca4-4234-a814-039ec362bc3f tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:39.881669 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d1cac563-7ca4-4234-a814-039ec362bc3f tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:39.888238 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d1cac563-7ca4-4234-a814-039ec362bc3f tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:39.888749 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d1cac563-7ca4-4234-a814-039ec362bc3f tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:39.889416 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d1cac563-7ca4-4234-a814-039ec362bc3f tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:39.889882 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d1cac563-7ca4-4234-a814-039ec362bc3f tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:40.032148 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d1cac563-7ca4-4234-a814-039ec362bc3f tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:40.040515 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d1cac563-7ca4-4234-a814-039ec362bc3f tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1750 microversion: 2.1 time: 0.164249 May 16 17:44:40.041084 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 295/566] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:39 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:41.062769 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a7a2b194-4ce3-4992-b527-2c431dba320a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:41.064443 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a7a2b194-4ce3-4992-b527-2c431dba320a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:41.072544 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a7a2b194-4ce3-4992-b527-2c431dba320a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:41.073094 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a7a2b194-4ce3-4992-b527-2c431dba320a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:41.074120 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a7a2b194-4ce3-4992-b527-2c431dba320a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:41.074647 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a7a2b194-4ce3-4992-b527-2c431dba320a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:41.251141 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-a7a2b194-4ce3-4992-b527-2c431dba320a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:41.259470 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a7a2b194-4ce3-4992-b527-2c431dba320a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1755 microversion: 2.1 time: 0.203465 May 16 17:44:41.260046 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 272/567] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:41 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1755 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:42.280152 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-dfc2117b-0c7e-4a56-9003-0e50acb13416 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:42.281148 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-dfc2117b-0c7e-4a56-9003-0e50acb13416 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:42.292094 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dfc2117b-0c7e-4a56-9003-0e50acb13416 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:42.292987 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dfc2117b-0c7e-4a56-9003-0e50acb13416 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:42.293905 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dfc2117b-0c7e-4a56-9003-0e50acb13416 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:42.294342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dfc2117b-0c7e-4a56-9003-0e50acb13416 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:42.451728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-dfc2117b-0c7e-4a56-9003-0e50acb13416 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:42.460032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-dfc2117b-0c7e-4a56-9003-0e50acb13416 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1755 microversion: 2.1 time: 0.186291 May 16 17:44:42.460885 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 296/568] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:42 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:43.481938 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a3e1c089-e1dc-4fe3-a013-fbc5cfd87191 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:43.482908 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a3e1c089-e1dc-4fe3-a013-fbc5cfd87191 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:43.493621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a3e1c089-e1dc-4fe3-a013-fbc5cfd87191 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:43.494381 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a3e1c089-e1dc-4fe3-a013-fbc5cfd87191 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:43.495625 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a3e1c089-e1dc-4fe3-a013-fbc5cfd87191 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:43.496174 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a3e1c089-e1dc-4fe3-a013-fbc5cfd87191 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:43.640308 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-a3e1c089-e1dc-4fe3-a013-fbc5cfd87191 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:43.652441 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a3e1c089-e1dc-4fe3-a013-fbc5cfd87191 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1755 microversion: 2.1 time: 0.176951 May 16 17:44:43.653165 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 273/569] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:43 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:44.679695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-bbc3a9c5-2832-4977-9c2f-7e0e669b73c3 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:44.680695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-bbc3a9c5-2832-4977-9c2f-7e0e669b73c3 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:44.688663 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bbc3a9c5-2832-4977-9c2f-7e0e669b73c3 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:44.689155 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bbc3a9c5-2832-4977-9c2f-7e0e669b73c3 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:44.690039 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bbc3a9c5-2832-4977-9c2f-7e0e669b73c3 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:44.690521 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bbc3a9c5-2832-4977-9c2f-7e0e669b73c3 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:44.835478 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-bbc3a9c5-2832-4977-9c2f-7e0e669b73c3 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:44.844010 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-bbc3a9c5-2832-4977-9c2f-7e0e669b73c3 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1755 microversion: 2.1 time: 0.170827 May 16 17:44:44.844593 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 297/570] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:44 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:45.865252 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-1b948003-868e-4136-9997-820efcd3c903 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:45.866406 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-1b948003-868e-4136-9997-820efcd3c903 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:45.877152 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1b948003-868e-4136-9997-820efcd3c903 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:45.877894 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1b948003-868e-4136-9997-820efcd3c903 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:45.879143 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1b948003-868e-4136-9997-820efcd3c903 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:45.879822 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1b948003-868e-4136-9997-820efcd3c903 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:46.030327 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-1b948003-868e-4136-9997-820efcd3c903 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:46.038500 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-1b948003-868e-4136-9997-820efcd3c903 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1755 microversion: 2.1 time: 0.179571 May 16 17:44:46.039094 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 274/571] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:45 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:47.059344 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f6f8d4bc-bd3e-4b12-810a-4303d50b552b tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:47.059952 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-f6f8d4bc-bd3e-4b12-810a-4303d50b552b tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:47.066686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f6f8d4bc-bd3e-4b12-810a-4303d50b552b tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:47.067131 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f6f8d4bc-bd3e-4b12-810a-4303d50b552b tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:47.067897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f6f8d4bc-bd3e-4b12-810a-4303d50b552b tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:47.068325 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f6f8d4bc-bd3e-4b12-810a-4303d50b552b tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:47.222977 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-f6f8d4bc-bd3e-4b12-810a-4303d50b552b tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:47.231324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f6f8d4bc-bd3e-4b12-810a-4303d50b552b tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1755 microversion: 2.1 time: 0.177865 May 16 17:44:47.231900 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 298/572] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:47 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:48.248543 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-090cea49-b454-4906-aed4-b55ee200e646 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:48.248913 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-090cea49-b454-4906-aed4-b55ee200e646 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:48.255742 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-090cea49-b454-4906-aed4-b55ee200e646 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:48.256153 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-090cea49-b454-4906-aed4-b55ee200e646 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:48.256974 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-090cea49-b454-4906-aed4-b55ee200e646 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:48.257582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-090cea49-b454-4906-aed4-b55ee200e646 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:48.403399 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-090cea49-b454-4906-aed4-b55ee200e646 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:48.411494 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-090cea49-b454-4906-aed4-b55ee200e646 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1755 microversion: 2.1 time: 0.167113 May 16 17:44:48.412132 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 275/573] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:48 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:49.433577 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f203c100-b72e-455e-8e1e-3b69aee7c790 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:49.434616 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-f203c100-b72e-455e-8e1e-3b69aee7c790 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:49.445446 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f203c100-b72e-455e-8e1e-3b69aee7c790 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:49.446295 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f203c100-b72e-455e-8e1e-3b69aee7c790 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:49.447523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f203c100-b72e-455e-8e1e-3b69aee7c790 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:49.448245 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f203c100-b72e-455e-8e1e-3b69aee7c790 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:49.615682 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-f203c100-b72e-455e-8e1e-3b69aee7c790 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:49.627780 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f203c100-b72e-455e-8e1e-3b69aee7c790 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1755 microversion: 2.1 time: 0.200485 May 16 17:44:49.628573 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 299/574] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:49 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1755 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:50.380684 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e215d772-5703-4180-aa0e-e39b0d8a32aa tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:44:50.381251 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e215d772-5703-4180-aa0e-e39b0d8a32aa tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:50.388011 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e215d772-5703-4180-aa0e-e39b0d8a32aa tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:50.388500 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e215d772-5703-4180-aa0e-e39b0d8a32aa tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:50.389285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e215d772-5703-4180-aa0e-e39b0d8a32aa tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:50.389764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e215d772-5703-4180-aa0e-e39b0d8a32aa tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:50.412470 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-e215d772-5703-4180-aa0e-e39b0d8a32aa tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lazy-loading 'flavor' on Instance uuid 643ca394-14c0-407b-be2a-3616138ebdb6 {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:44:50.494194 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e215d772-5703-4180-aa0e-e39b0d8a32aa tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "POST /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6/action" status: 202 len: 0 microversion: 2.1 time: 0.117275 May 16 17:44:50.497580 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 276/575] 10.222.0.58 () {60 vars in 1277 bytes} [Mon May 16 17:44:50 2022] POST /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:44:50.503319 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-276084e9-b877-49f9-829a-b38d5e407931 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:50.503926 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-276084e9-b877-49f9-829a-b38d5e407931 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:50.510502 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-276084e9-b877-49f9-829a-b38d5e407931 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:50.510953 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-276084e9-b877-49f9-829a-b38d5e407931 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:50.511718 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-276084e9-b877-49f9-829a-b38d5e407931 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:50.512154 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-276084e9-b877-49f9-829a-b38d5e407931 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:50.650449 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b6e7a813-4914-4df2-8681-92e76f1e693e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:50.651157 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-276084e9-b877-49f9-829a-b38d5e407931 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:50.651285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b6e7a813-4914-4df2-8681-92e76f1e693e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:50.658065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b6e7a813-4914-4df2-8681-92e76f1e693e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:50.658517 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b6e7a813-4914-4df2-8681-92e76f1e693e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:50.658993 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-276084e9-b877-49f9-829a-b38d5e407931 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1568 microversion: 2.1 time: 0.159569 May 16 17:44:50.659299 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b6e7a813-4914-4df2-8681-92e76f1e693e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:50.659611 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 300/576] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:50 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:50.659773 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b6e7a813-4914-4df2-8681-92e76f1e693e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:50.807813 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-b6e7a813-4914-4df2-8681-92e76f1e693e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:50.816612 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b6e7a813-4914-4df2-8681-92e76f1e693e tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1755 microversion: 2.1 time: 0.171736 May 16 17:44:50.817180 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 277/577] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:50 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:51.680604 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-a75a70b2-9a96-475a-accf-5a7ee7dc3269 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:51.681603 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a75a70b2-9a96-475a-accf-5a7ee7dc3269 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:51.690325 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a75a70b2-9a96-475a-accf-5a7ee7dc3269 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:51.690813 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a75a70b2-9a96-475a-accf-5a7ee7dc3269 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:51.691946 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a75a70b2-9a96-475a-accf-5a7ee7dc3269 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:51.692536 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a75a70b2-9a96-475a-accf-5a7ee7dc3269 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:51.838614 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-1fe7a463-825d-49db-ad40-2b4b880f25c9 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:51.839121 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-a75a70b2-9a96-475a-accf-5a7ee7dc3269 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:51.839259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-1fe7a463-825d-49db-ad40-2b4b880f25c9 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:51.845887 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1fe7a463-825d-49db-ad40-2b4b880f25c9 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:51.846348 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1fe7a463-825d-49db-ad40-2b4b880f25c9 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:51.846739 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-a75a70b2-9a96-475a-accf-5a7ee7dc3269 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1568 microversion: 2.1 time: 0.172799 May 16 17:44:51.847122 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1fe7a463-825d-49db-ad40-2b4b880f25c9 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:51.847593 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 301/578] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:51 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:51.847726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1fe7a463-825d-49db-ad40-2b4b880f25c9 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:51.992583 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-1fe7a463-825d-49db-ad40-2b4b880f25c9 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:52.005830 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-1fe7a463-825d-49db-ad40-2b4b880f25c9 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1755 microversion: 2.1 time: 0.170993 May 16 17:44:52.006614 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 278/579] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:51 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:52.868447 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d920a99e-f489-4188-bc61-4b1cf6ced5d1 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:52.869063 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d920a99e-f489-4188-bc61-4b1cf6ced5d1 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:52.875396 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d920a99e-f489-4188-bc61-4b1cf6ced5d1 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:52.876115 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d920a99e-f489-4188-bc61-4b1cf6ced5d1 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:52.877143 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d920a99e-f489-4188-bc61-4b1cf6ced5d1 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:52.878339 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d920a99e-f489-4188-bc61-4b1cf6ced5d1 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:53.012459 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d920a99e-f489-4188-bc61-4b1cf6ced5d1 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:53.020084 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d920a99e-f489-4188-bc61-4b1cf6ced5d1 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1568 microversion: 2.1 time: 0.157920 May 16 17:44:53.020957 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 302/580] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:52 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:53.025390 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b182a6de-cf45-4e66-b888-859ac0179642 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:53.026008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b182a6de-cf45-4e66-b888-859ac0179642 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:53.032873 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b182a6de-cf45-4e66-b888-859ac0179642 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:53.033314 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b182a6de-cf45-4e66-b888-859ac0179642 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:53.034124 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b182a6de-cf45-4e66-b888-859ac0179642 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:53.034554 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b182a6de-cf45-4e66-b888-859ac0179642 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:53.179465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-b182a6de-cf45-4e66-b888-859ac0179642 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:53.189301 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b182a6de-cf45-4e66-b888-859ac0179642 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1755 microversion: 2.1 time: 0.167811 May 16 17:44:53.190109 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 279/581] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:53 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:44:54.041902 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8755460f-3c80-4844-8681-4e449f8ddc02 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:54.043010 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-8755460f-3c80-4844-8681-4e449f8ddc02 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:54.051193 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8755460f-3c80-4844-8681-4e449f8ddc02 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:54.051639 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8755460f-3c80-4844-8681-4e449f8ddc02 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:54.052402 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8755460f-3c80-4844-8681-4e449f8ddc02 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:54.052833 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8755460f-3c80-4844-8681-4e449f8ddc02 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:54.185362 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-8755460f-3c80-4844-8681-4e449f8ddc02 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:54.193356 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-8755460f-3c80-4844-8681-4e449f8ddc02 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1568 microversion: 2.1 time: 0.158319 May 16 17:44:54.193962 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 303/582] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:54 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:54.207549 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4d2a8ba5-fbd5-472f-afd1-742cbaf8a4ef tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:54.208262 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4d2a8ba5-fbd5-472f-afd1-742cbaf8a4ef tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:54.217618 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4d2a8ba5-fbd5-472f-afd1-742cbaf8a4ef tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:54.218437 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4d2a8ba5-fbd5-472f-afd1-742cbaf8a4ef tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:54.219658 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4d2a8ba5-fbd5-472f-afd1-742cbaf8a4ef tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:54.220202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4d2a8ba5-fbd5-472f-afd1-742cbaf8a4ef tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:54.371547 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-4d2a8ba5-fbd5-472f-afd1-742cbaf8a4ef tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:54.380271 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4d2a8ba5-fbd5-472f-afd1-742cbaf8a4ef tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1755 microversion: 2.1 time: 0.176659 May 16 17:44:54.380861 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 280/583] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:54 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:44:55.211627 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f35050a9-460e-400a-a66a-0099420caf37 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:55.212298 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-f35050a9-460e-400a-a66a-0099420caf37 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:55.219796 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f35050a9-460e-400a-a66a-0099420caf37 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:55.220256 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f35050a9-460e-400a-a66a-0099420caf37 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:55.221032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f35050a9-460e-400a-a66a-0099420caf37 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:55.221457 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f35050a9-460e-400a-a66a-0099420caf37 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:55.399348 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-623c0cf0-4b20-4065-94ef-857cc3f9a927 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:55.400056 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-623c0cf0-4b20-4065-94ef-857cc3f9a927 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:55.410356 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-623c0cf0-4b20-4065-94ef-857cc3f9a927 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:55.410795 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-623c0cf0-4b20-4065-94ef-857cc3f9a927 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:55.412109 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-623c0cf0-4b20-4065-94ef-857cc3f9a927 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:55.412883 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-623c0cf0-4b20-4065-94ef-857cc3f9a927 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:55.504438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-f35050a9-460e-400a-a66a-0099420caf37 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:55.512281 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f35050a9-460e-400a-a66a-0099420caf37 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1568 microversion: 2.1 time: 0.305170 May 16 17:44:55.512868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 304/584] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:55 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1568 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:55.617395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-623c0cf0-4b20-4065-94ef-857cc3f9a927 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:55.629235 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-623c0cf0-4b20-4065-94ef-857cc3f9a927 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1755 microversion: 2.1 time: 0.234744 May 16 17:44:55.630062 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 281/585] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:55 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1755 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:55.781585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-9659cd65-fc9d-4491-abe6-0bbb915cb4c5 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:55.782097 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-9659cd65-fc9d-4491-abe6-0bbb915cb4c5 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:55.788633 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9659cd65-fc9d-4491-abe6-0bbb915cb4c5 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:55.789081 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9659cd65-fc9d-4491-abe6-0bbb915cb4c5 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:55.789889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9659cd65-fc9d-4491-abe6-0bbb915cb4c5 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:55.790336 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9659cd65-fc9d-4491-abe6-0bbb915cb4c5 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:55.875235 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.objects.instance [None req-9659cd65-fc9d-4491-abe6-0bbb915cb4c5 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lazy-loading 'services' on Instance uuid 6338a689-ab4a-4936-93e3-a225bce4f5f9 {{(pid=128815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:44:55.954668 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-9659cd65-fc9d-4491-abe6-0bbb915cb4c5 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9/os-volume_attachments/4c9e9d25-06de-4402-a81a-f88931d01842" status: 202 len: 0 microversion: 2.1 time: 0.179601 May 16 17:44:55.955284 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 305/586] 10.222.0.58 () {58 vars in 1415 bytes} [Mon May 16 17:44:55 2022] DELETE /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9/os-volume_attachments/4c9e9d25-06de-4402-a81a-f88931d01842 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:44:56.532351 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-cbe585d3-284d-4822-9b9d-67030d9d634a tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:56.533036 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-cbe585d3-284d-4822-9b9d-67030d9d634a tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:56.541059 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cbe585d3-284d-4822-9b9d-67030d9d634a tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:56.541999 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cbe585d3-284d-4822-9b9d-67030d9d634a tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:56.542904 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cbe585d3-284d-4822-9b9d-67030d9d634a tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:56.543411 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-cbe585d3-284d-4822-9b9d-67030d9d634a tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:56.650567 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e20151a4-a1ff-4400-8fe1-60862d2dc54c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:56.651293 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-e20151a4-a1ff-4400-8fe1-60862d2dc54c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:56.659451 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e20151a4-a1ff-4400-8fe1-60862d2dc54c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:56.659907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e20151a4-a1ff-4400-8fe1-60862d2dc54c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:56.660698 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e20151a4-a1ff-4400-8fe1-60862d2dc54c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:56.661103 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e20151a4-a1ff-4400-8fe1-60862d2dc54c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:56.681403 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-cbe585d3-284d-4822-9b9d-67030d9d634a tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:56.689973 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-cbe585d3-284d-4822-9b9d-67030d9d634a tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1568 microversion: 2.1 time: 0.163806 May 16 17:44:56.691090 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 282/587] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:56 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:56.816199 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-e20151a4-a1ff-4400-8fe1-60862d2dc54c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:56.828410 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-e20151a4-a1ff-4400-8fe1-60862d2dc54c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1755 microversion: 2.1 time: 0.181835 May 16 17:44:56.829190 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 306/588] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:56 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:57.103901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-18e7b708-170c-471b-a495-c24420808b87 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:57.104405 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-18e7b708-170c-471b-a495-c24420808b87 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:57.110950 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-18e7b708-170c-471b-a495-c24420808b87 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:57.111411 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-18e7b708-170c-471b-a495-c24420808b87 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:57.112174 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-18e7b708-170c-471b-a495-c24420808b87 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:57.112608 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-18e7b708-170c-471b-a495-c24420808b87 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:57.138549 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-18e7b708-170c-471b-a495-c24420808b87 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] Going to try to terminate instance {{(pid=128816) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:44:57.220437 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-18e7b708-170c-471b-a495-c24420808b87 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9" status: 204 len: 0 microversion: 2.1 time: 0.123643 May 16 17:44:57.221039 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 283/589] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:44:57 2022] DELETE /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:44:57.229685 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5d611318-a2ad-4f76-b6c0-8614262146d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:57.230315 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-5d611318-a2ad-4f76-b6c0-8614262146d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:57.236631 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5d611318-a2ad-4f76-b6c0-8614262146d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:57.237077 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5d611318-a2ad-4f76-b6c0-8614262146d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:57.237892 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5d611318-a2ad-4f76-b6c0-8614262146d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:57.238336 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5d611318-a2ad-4f76-b6c0-8614262146d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:57.369121 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-5d611318-a2ad-4f76-b6c0-8614262146d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:57.377181 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-5d611318-a2ad-4f76-b6c0-8614262146d8 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9" status: 200 len: 1558 microversion: 2.1 time: 0.151541 May 16 17:44:57.377788 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 307/590] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:57 2022] GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:57.709369 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-53a92490-e7df-4b45-9778-5e96dc8f86d5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:57.710217 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-53a92490-e7df-4b45-9778-5e96dc8f86d5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:57.717229 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-53a92490-e7df-4b45-9778-5e96dc8f86d5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:57.717714 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-53a92490-e7df-4b45-9778-5e96dc8f86d5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:57.718511 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-53a92490-e7df-4b45-9778-5e96dc8f86d5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:57.718955 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-53a92490-e7df-4b45-9778-5e96dc8f86d5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:57.851504 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-99236bc0-7dd4-4c92-948b-cd73c9e2fcbe tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:57.852037 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-99236bc0-7dd4-4c92-948b-cd73c9e2fcbe tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:57.856064 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-53a92490-e7df-4b45-9778-5e96dc8f86d5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:57.858121 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-99236bc0-7dd4-4c92-948b-cd73c9e2fcbe tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:57.858570 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-99236bc0-7dd4-4c92-948b-cd73c9e2fcbe tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:57.859402 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-99236bc0-7dd4-4c92-948b-cd73c9e2fcbe tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:57.859834 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-99236bc0-7dd4-4c92-948b-cd73c9e2fcbe tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:57.864508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-53a92490-e7df-4b45-9778-5e96dc8f86d5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1568 microversion: 2.1 time: 0.159686 May 16 17:44:57.865202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 284/591] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:57 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:58.013316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-99236bc0-7dd4-4c92-948b-cd73c9e2fcbe tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:58.021696 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-99236bc0-7dd4-4c92-948b-cd73c9e2fcbe tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1758 microversion: 2.1 time: 0.174204 May 16 17:44:58.022280 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 308/592] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:57 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:58.395512 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e2a7704f-8a97-4b9a-8d10-0052d4b8c077 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:58.396159 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e2a7704f-8a97-4b9a-8d10-0052d4b8c077 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:58.403378 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e2a7704f-8a97-4b9a-8d10-0052d4b8c077 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:58.403851 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e2a7704f-8a97-4b9a-8d10-0052d4b8c077 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:58.404625 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e2a7704f-8a97-4b9a-8d10-0052d4b8c077 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:58.405088 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e2a7704f-8a97-4b9a-8d10-0052d4b8c077 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:58.546615 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e2a7704f-8a97-4b9a-8d10-0052d4b8c077 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:58.554327 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e2a7704f-8a97-4b9a-8d10-0052d4b8c077 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9" status: 200 len: 1512 microversion: 2.1 time: 0.163193 May 16 17:44:58.554871 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 285/593] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:58 2022] GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:58.886083 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5cb0e4c9-0045-46b9-a9e9-3a48d1174a21 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:58.887075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-5cb0e4c9-0045-46b9-a9e9-3a48d1174a21 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:58.897876 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5cb0e4c9-0045-46b9-a9e9-3a48d1174a21 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:58.898615 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5cb0e4c9-0045-46b9-a9e9-3a48d1174a21 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:58.899866 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5cb0e4c9-0045-46b9-a9e9-3a48d1174a21 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:58.900588 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5cb0e4c9-0045-46b9-a9e9-3a48d1174a21 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:59.040545 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-5cb0e4c9-0045-46b9-a9e9-3a48d1174a21 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:59.049396 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-5cb0e4c9-0045-46b9-a9e9-3a48d1174a21 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1568 microversion: 2.1 time: 0.169870 May 16 17:44:59.050046 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 309/594] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:58 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:44:59.571699 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-2f68c899-3fc4-4cfa-9bea-215fcd6c3649 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:44:59.572479 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-2f68c899-3fc4-4cfa-9bea-215fcd6c3649 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:44:59.580423 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2f68c899-3fc4-4cfa-9bea-215fcd6c3649 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:59.580872 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2f68c899-3fc4-4cfa-9bea-215fcd6c3649 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:59.581681 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2f68c899-3fc4-4cfa-9bea-215fcd6c3649 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:44:59.582113 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2f68c899-3fc4-4cfa-9bea-215fcd6c3649 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:44:59.710289 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-2f68c899-3fc4-4cfa-9bea-215fcd6c3649 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9e1d2049fa4330b1f78692e9ab7b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e740d27d929404fbc7a4964dab899d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:44:59.717922 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-2f68c899-3fc4-4cfa-9bea-215fcd6c3649 tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9" status: 200 len: 1512 microversion: 2.1 time: 0.150527 May 16 17:44:59.718494 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 286/595] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:44:59 2022] GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:00.028505 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-1e0414b9-dec5-46ed-aac7-62bc1cbee054 req-2237892d-f6a6-40f4-8f40-e2e4f531857b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6338a689-ab4a-4936-93e3-a225bce4f5f9", "name": "network-vif-deleted", "tag": "3fcae629-8202-4a66-ae4b-06c3c7cfddfc"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:00.038527 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-1e0414b9-dec5-46ed-aac7-62bc1cbee054 req-2237892d-f6a6-40f4-8f40-e2e4f531857b service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:00.038949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-1e0414b9-dec5-46ed-aac7-62bc1cbee054 req-2237892d-f6a6-40f4-8f40-e2e4f531857b service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:00.051603 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-1e0414b9-dec5-46ed-aac7-62bc1cbee054 req-2237892d-f6a6-40f4-8f40-e2e4f531857b service nova] Creating event network-vif-deleted:3fcae629-8202-4a66-ae4b-06c3c7cfddfc for instance 6338a689-ab4a-4936-93e3-a225bce4f5f9 on hv-cinder-83769 May 16 17:45:00.057888 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-1e0414b9-dec5-46ed-aac7-62bc1cbee054 req-2237892d-f6a6-40f4-8f40-e2e4f531857b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032380 May 16 17:45:00.058491 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 310/596] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:45:00.066451 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d6410b61-f924-4cd3-a4e8-9e9ede6ea773 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:00.067211 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d6410b61-f924-4cd3-a4e8-9e9ede6ea773 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:00.073817 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d6410b61-f924-4cd3-a4e8-9e9ede6ea773 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:00.074647 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d6410b61-f924-4cd3-a4e8-9e9ede6ea773 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:00.075389 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d6410b61-f924-4cd3-a4e8-9e9ede6ea773 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:00.075769 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d6410b61-f924-4cd3-a4e8-9e9ede6ea773 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:00.209979 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d6410b61-f924-4cd3-a4e8-9e9ede6ea773 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:00.217683 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d6410b61-f924-4cd3-a4e8-9e9ede6ea773 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1568 microversion: 2.1 time: 0.155155 May 16 17:45:00.218240 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 287/597] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:00 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:00.735756 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-55ee8d7b-6087-436c-9bc2-e8d78fa0b21e tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:00.736434 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-55ee8d7b-6087-436c-9bc2-e8d78fa0b21e tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] [instance: 6338a689-ab4a-4936-93e3-a225bce4f5f9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:00.743122 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55ee8d7b-6087-436c-9bc2-e8d78fa0b21e tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:00.743568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55ee8d7b-6087-436c-9bc2-e8d78fa0b21e tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:00.744323 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55ee8d7b-6087-436c-9bc2-e8d78fa0b21e tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:00.744752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55ee8d7b-6087-436c-9bc2-e8d78fa0b21e tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:00.758600 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-55ee8d7b-6087-436c-9bc2-e8d78fa0b21e tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] HTTP exception thrown: Instance 6338a689-ab4a-4936-93e3-a225bce4f5f9 could not be found. May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-55ee8d7b-6087-436c-9bc2-e8d78fa0b21e tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Request method failure captured: May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9 HTTP/1.1 May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigo0r_wgJiXkhMp5zepBpGGuEIcxUonfLRMoyqEXGsSDV-XVFIssW8NH9Sxq1d0iaK5eRMadzmWQvDeGKy1dFqfk1hw9jO6s-CACYLhXESImLVGUBdRoCtmdoLOxL2ZHSeIPqdqkDJrIeraJGaJ74DlhntxFCzhwxoK6Luo3CuwmklN8 May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 8e740d27d929404fbc7a4964dab899d0 May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1499934369 May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:45:00.760246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:45:00.761869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e740d27d929404fbc7a4964dab899d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8e740d27d929404fbc7a4964dab899d0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8e740d27d929404fbc7a4964dab899d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e740d27d929404fbc7a4964dab899d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:45:00.761869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-VolumesSnapshotTestJSON-1499934369 May 16 17:45:00.761869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 8e740d27d929404fbc7a4964dab899d0 May 16 17:45:00.761869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1499934369 May 16 17:45:00.761869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-VolumesSnapshotTestJSON-1499934369-project May 16 17:45:00.761869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:45:00.761869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:45:00.761869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: ad9e1d2049fa4330b1f78692e9ab7b10 May 16 17:45:00.761869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-VolumesSnapshotTestJSON-1499934369-project May 16 17:45:00.761869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:45:00.761869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance 6338a689-ab4a-4936-93e3-a225bce4f5f9 could not be found. May 16 17:45:00.761869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': '6338a689-ab4a-4936-93e3-a225bce4f5f9'} May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6338a689-ab4a-4936-93e3-a225bce4f5f9 could not be found. May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:45:00.762752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:45:00.764342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:45:00.764342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:45:00.764342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:45:00.764342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:45:00.764342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:45:00.764342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:45:00.764342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:45:00.764342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6338a689-ab4a-4936-93e3-a225bce4f5f9 could not be found. May 16 17:45:00.764342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:00.764342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:45:00.764342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:00.764342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:00.764342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:45:00.764342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:45:00.764342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:45:00.764342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:45:00.764342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6338a689-ab4a-4936-93e3-a225bce4f5f9 could not be found. May 16 17:45:00.764342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:00.766047 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-55ee8d7b-6087-436c-9bc2-e8d78fa0b21e tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] Returning 404 to user: Instance 6338a689-ab4a-4936-93e3-a225bce4f5f9 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:45:00.766047 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-55ee8d7b-6087-436c-9bc2-e8d78fa0b21e tempest-VolumesSnapshotTestJSON-1499934369 tempest-VolumesSnapshotTestJSON-1499934369-project] 10.222.0.58 "GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9" status: 404 len: 111 microversion: 2.1 time: 0.030361 May 16 17:45:00.766047 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 311/598] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:00 2022] GET /compute/v2.1/servers/6338a689-ab4a-4936-93e3-a225bce4f5f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:45:01.234822 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-873238d3-30d7-4571-93b8-801b513c6f2f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:01.235442 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-873238d3-30d7-4571-93b8-801b513c6f2f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:01.242455 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-873238d3-30d7-4571-93b8-801b513c6f2f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:01.242903 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-873238d3-30d7-4571-93b8-801b513c6f2f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:01.243673 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-873238d3-30d7-4571-93b8-801b513c6f2f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:01.244104 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-873238d3-30d7-4571-93b8-801b513c6f2f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:01.383553 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-873238d3-30d7-4571-93b8-801b513c6f2f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:01.391528 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-873238d3-30d7-4571-93b8-801b513c6f2f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1568 microversion: 2.1 time: 0.160659 May 16 17:45:01.392265 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 288/599] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:01 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:02.412008 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-c3a88e54-d21f-464b-9d69-250faab2b836 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:02.412788 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-c3a88e54-d21f-464b-9d69-250faab2b836 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:02.423425 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c3a88e54-d21f-464b-9d69-250faab2b836 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:02.423868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c3a88e54-d21f-464b-9d69-250faab2b836 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:02.424631 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c3a88e54-d21f-464b-9d69-250faab2b836 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:02.425057 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c3a88e54-d21f-464b-9d69-250faab2b836 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:02.563453 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-c3a88e54-d21f-464b-9d69-250faab2b836 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:02.571906 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-c3a88e54-d21f-464b-9d69-250faab2b836 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1568 microversion: 2.1 time: 0.166120 May 16 17:45:02.572468 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 312/600] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:02 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:03.592264 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f8231daa-34d8-4c6b-bd7d-4b84cb23551e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:03.593309 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-f8231daa-34d8-4c6b-bd7d-4b84cb23551e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:03.604089 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f8231daa-34d8-4c6b-bd7d-4b84cb23551e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:03.604816 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f8231daa-34d8-4c6b-bd7d-4b84cb23551e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:03.606131 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f8231daa-34d8-4c6b-bd7d-4b84cb23551e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:03.606839 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f8231daa-34d8-4c6b-bd7d-4b84cb23551e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:03.728077 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5c304915-8be3-4651-8fb8-d1db694b88e5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:03.729180 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-5c304915-8be3-4651-8fb8-d1db694b88e5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:03.735761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5c304915-8be3-4651-8fb8-d1db694b88e5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:03.736214 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5c304915-8be3-4651-8fb8-d1db694b88e5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:03.736984 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5c304915-8be3-4651-8fb8-d1db694b88e5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:03.737448 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5c304915-8be3-4651-8fb8-d1db694b88e5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:03.745852 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f8231daa-34d8-4c6b-bd7d-4b84cb23551e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:03.753695 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f8231daa-34d8-4c6b-bd7d-4b84cb23551e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1568 microversion: 2.1 time: 0.167853 May 16 17:45:03.754279 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 289/601] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:03 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:03.761720 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-5c304915-8be3-4651-8fb8-d1db694b88e5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489/ips" status: 200 len: 150 microversion: 2.1 time: 0.036726 May 16 17:45:03.763147 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 313/602] 10.222.0.58 () {58 vars in 1247 bytes} [Mon May 16 17:45:03 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:45:03.846958 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ca0e9157-01bd-4e9d-a169-f348d05c5305 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:03.847360 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-ca0e9157-01bd-4e9d-a169-f348d05c5305 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:03.853297 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ca0e9157-01bd-4e9d-a169-f348d05c5305 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:03.853781 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ca0e9157-01bd-4e9d-a169-f348d05c5305 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:03.854566 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ca0e9157-01bd-4e9d-a169-f348d05c5305 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:03.854994 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ca0e9157-01bd-4e9d-a169-f348d05c5305 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:03.989276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-ca0e9157-01bd-4e9d-a169-f348d05c5305 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lazy-loading 'services' on Instance uuid ae780970-4212-46bc-8038-69067eb4e039 {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:45:04.105965 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ca0e9157-01bd-4e9d-a169-f348d05c5305 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-volume_attachments/20c7aac5-4970-47e1-a405-fa325a327c54" status: 202 len: 0 microversion: 2.1 time: 0.262805 May 16 17:45:04.106493 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 290/603] 10.222.0.58 () {58 vars in 1415 bytes} [Mon May 16 17:45:03 2022] DELETE /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-volume_attachments/20c7aac5-4970-47e1-a405-fa325a327c54 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:45:04.115232 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-76522f17-d36b-49c7-9aeb-6ec7bc67e985 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:04.116279 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-76522f17-d36b-49c7-9aeb-6ec7bc67e985 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:04.122511 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-76522f17-d36b-49c7-9aeb-6ec7bc67e985 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:04.122959 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-76522f17-d36b-49c7-9aeb-6ec7bc67e985 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:04.123728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-76522f17-d36b-49c7-9aeb-6ec7bc67e985 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:04.124160 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-76522f17-d36b-49c7-9aeb-6ec7bc67e985 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:04.154967 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-76522f17-d36b-49c7-9aeb-6ec7bc67e985 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043834 May 16 17:45:04.155533 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 314/604] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:45:04 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:45:04.776544 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-6b1487e9-2073-4cc0-b46c-6813264e2435 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:04.777756 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-6b1487e9-2073-4cc0-b46c-6813264e2435 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:04.786821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6b1487e9-2073-4cc0-b46c-6813264e2435 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:04.787274 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6b1487e9-2073-4cc0-b46c-6813264e2435 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:04.788046 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6b1487e9-2073-4cc0-b46c-6813264e2435 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:04.788482 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6b1487e9-2073-4cc0-b46c-6813264e2435 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:04.924853 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-6b1487e9-2073-4cc0-b46c-6813264e2435 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:04.932259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-6b1487e9-2073-4cc0-b46c-6813264e2435 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1568 microversion: 2.1 time: 0.163631 May 16 17:45:04.937528 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 291/605] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:04 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:05.167768 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-688cae48-974b-4ad6-a552-8b25bf20bea0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:05.168704 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-688cae48-974b-4ad6-a552-8b25bf20bea0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:05.175425 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-688cae48-974b-4ad6-a552-8b25bf20bea0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:05.175894 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-688cae48-974b-4ad6-a552-8b25bf20bea0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:05.176684 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-688cae48-974b-4ad6-a552-8b25bf20bea0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:05.177128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-688cae48-974b-4ad6-a552-8b25bf20bea0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:05.206664 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-688cae48-974b-4ad6-a552-8b25bf20bea0 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043329 May 16 17:45:05.207211 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 315/606] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:45:05 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:45:05.949989 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-bd84b46c-aaf1-458f-a892-9f48b28783b2 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:05.950605 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-bd84b46c-aaf1-458f-a892-9f48b28783b2 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:05.957642 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bd84b46c-aaf1-458f-a892-9f48b28783b2 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:05.958078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bd84b46c-aaf1-458f-a892-9f48b28783b2 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:05.958836 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bd84b46c-aaf1-458f-a892-9f48b28783b2 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:05.959330 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bd84b46c-aaf1-458f-a892-9f48b28783b2 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:06.092387 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-bd84b46c-aaf1-458f-a892-9f48b28783b2 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:06.099891 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-bd84b46c-aaf1-458f-a892-9f48b28783b2 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1568 microversion: 2.1 time: 0.153986 May 16 17:45:06.100587 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 292/607] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:05 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:06.220954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-208b8f3f-d464-4ec8-b048-3e61d5656dfd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:06.222197 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-208b8f3f-d464-4ec8-b048-3e61d5656dfd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:06.240039 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-208b8f3f-d464-4ec8-b048-3e61d5656dfd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:06.240541 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-208b8f3f-d464-4ec8-b048-3e61d5656dfd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:06.241404 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-208b8f3f-d464-4ec8-b048-3e61d5656dfd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:06.241934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-208b8f3f-d464-4ec8-b048-3e61d5656dfd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:06.274926 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-208b8f3f-d464-4ec8-b048-3e61d5656dfd tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058186 May 16 17:45:06.279594 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 316/608] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:45:06 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:45:06.283431 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-876723e7-8092-4d93-a4ec-e90bdee95347 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb64405d-7d5a-41af-bae5-d345e5560f46"}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:06.284973 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-876723e7-8092-4d93-a4ec-e90bdee95347 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:06.291928 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-876723e7-8092-4d93-a4ec-e90bdee95347 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:06.292376 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-876723e7-8092-4d93-a4ec-e90bdee95347 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:06.293171 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-876723e7-8092-4d93-a4ec-e90bdee95347 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:06.293591 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-876723e7-8092-4d93-a4ec-e90bdee95347 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:06.544596 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-876723e7-8092-4d93-a4ec-e90bdee95347 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "POST /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267564 May 16 17:45:06.545271 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 293/609] 10.222.0.58 () {60 vars in 1322 bytes} [Mon May 16 17:45:06 2022] POST /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:45:07.117388 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d1ace7e8-b9ea-4396-b3a7-d349e65017e7 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:07.118027 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d1ace7e8-b9ea-4396-b3a7-d349e65017e7 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:07.124798 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d1ace7e8-b9ea-4396-b3a7-d349e65017e7 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:07.125295 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d1ace7e8-b9ea-4396-b3a7-d349e65017e7 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:07.126187 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d1ace7e8-b9ea-4396-b3a7-d349e65017e7 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:07.126689 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d1ace7e8-b9ea-4396-b3a7-d349e65017e7 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:07.265397 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d1ace7e8-b9ea-4396-b3a7-d349e65017e7 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:07.277143 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d1ace7e8-b9ea-4396-b3a7-d349e65017e7 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1509 microversion: 2.1 time: 0.164055 May 16 17:45:07.277989 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 317/610] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:07 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:07.290532 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-20503d3a-cb4e-4bf5-a287-4f7ae61467db tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:07.291967 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-20503d3a-cb4e-4bf5-a287-4f7ae61467db tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:07.296452 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-39c0fa0f-fb15-4763-9238-a23e3103b072 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:07.296993 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-39c0fa0f-fb15-4763-9238-a23e3103b072 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:07.299056 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-20503d3a-cb4e-4bf5-a287-4f7ae61467db tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:07.299499 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-20503d3a-cb4e-4bf5-a287-4f7ae61467db tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:07.300409 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-20503d3a-cb4e-4bf5-a287-4f7ae61467db tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:07.300848 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-20503d3a-cb4e-4bf5-a287-4f7ae61467db tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:07.303229 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-39c0fa0f-fb15-4763-9238-a23e3103b072 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:07.303687 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-39c0fa0f-fb15-4763-9238-a23e3103b072 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:07.304500 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-39c0fa0f-fb15-4763-9238-a23e3103b072 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:07.305592 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-39c0fa0f-fb15-4763-9238-a23e3103b072 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:07.331914 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-20503d3a-cb4e-4bf5-a287-4f7ae61467db tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047031 May 16 17:45:07.332501 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 294/611] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:45:07 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 17:45:07.402908 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-39c0fa0f-fb15-4763-9238-a23e3103b072 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "POST /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6/action" status: 202 len: 0 microversion: 2.1 time: 0.110606 May 16 17:45:07.404229 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 318/612] 10.222.0.58 () {60 vars in 1277 bytes} [Mon May 16 17:45:07 2022] POST /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:45:07.409663 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4797cebc-ba5d-4607-9708-cf1abe041d85 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:07.410138 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4797cebc-ba5d-4607-9708-cf1abe041d85 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:07.411785 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-134559cf-8eea-4d75-8aaf-9aacc298f9ed tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:07.412395 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-134559cf-8eea-4d75-8aaf-9aacc298f9ed tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:07.416888 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4797cebc-ba5d-4607-9708-cf1abe041d85 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:07.417340 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4797cebc-ba5d-4607-9708-cf1abe041d85 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:07.418143 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4797cebc-ba5d-4607-9708-cf1abe041d85 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:07.418578 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4797cebc-ba5d-4607-9708-cf1abe041d85 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:07.419084 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-134559cf-8eea-4d75-8aaf-9aacc298f9ed tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:07.419534 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-134559cf-8eea-4d75-8aaf-9aacc298f9ed tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:07.420300 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-134559cf-8eea-4d75-8aaf-9aacc298f9ed tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:07.420732 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-134559cf-8eea-4d75-8aaf-9aacc298f9ed tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:07.445055 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4797cebc-ba5d-4607-9708-cf1abe041d85 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Going to try to terminate instance {{(pid=128816) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:45:07.536527 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4797cebc-ba5d-4607-9708-cf1abe041d85 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 204 len: 0 microversion: 2.1 time: 0.130827 May 16 17:45:07.540279 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 295/613] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:45:07 2022] DELETE /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:45:07.546595 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-53fba8e6-bfa6-4950-a25e-ac752473a452 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:07.547373 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-53fba8e6-bfa6-4950-a25e-ac752473a452 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:07.553908 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-53fba8e6-bfa6-4950-a25e-ac752473a452 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:07.554453 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-53fba8e6-bfa6-4950-a25e-ac752473a452 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:07.555855 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-53fba8e6-bfa6-4950-a25e-ac752473a452 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:07.556298 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-53fba8e6-bfa6-4950-a25e-ac752473a452 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:07.564948 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-134559cf-8eea-4d75-8aaf-9aacc298f9ed tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:07.573210 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-134559cf-8eea-4d75-8aaf-9aacc298f9ed tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1517 microversion: 2.1 time: 0.165120 May 16 17:45:07.573794 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 319/614] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:07 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:45:07.700108 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-53fba8e6-bfa6-4950-a25e-ac752473a452 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:07.707784 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-53fba8e6-bfa6-4950-a25e-ac752473a452 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1689 microversion: 2.1 time: 0.165417 May 16 17:45:07.708367 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 296/615] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:07 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:45:08.086397 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:45:08.086657 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Mon May 16 17:45:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:45:08.594939 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8bd9b504-c5c5-4513-8049-cc4b84e7cf53 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:08.595977 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-8bd9b504-c5c5-4513-8049-cc4b84e7cf53 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:08.603750 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8bd9b504-c5c5-4513-8049-cc4b84e7cf53 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:08.604200 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8bd9b504-c5c5-4513-8049-cc4b84e7cf53 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:08.604961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8bd9b504-c5c5-4513-8049-cc4b84e7cf53 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:08.605385 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8bd9b504-c5c5-4513-8049-cc4b84e7cf53 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:08.724422 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-28fe4f3e-de4d-482e-aa55-a779737e4f72 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:08.725028 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-28fe4f3e-de4d-482e-aa55-a779737e4f72 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:08.731622 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-28fe4f3e-de4d-482e-aa55-a779737e4f72 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:08.732072 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-28fe4f3e-de4d-482e-aa55-a779737e4f72 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:08.732813 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-28fe4f3e-de4d-482e-aa55-a779737e4f72 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:08.733266 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-28fe4f3e-de4d-482e-aa55-a779737e4f72 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:08.744855 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-8bd9b504-c5c5-4513-8049-cc4b84e7cf53 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:08.752849 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-8bd9b504-c5c5-4513-8049-cc4b84e7cf53 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1517 microversion: 2.1 time: 0.164448 May 16 17:45:08.753448 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 320/616] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:08 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:08.866722 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-28fe4f3e-de4d-482e-aa55-a779737e4f72 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:08.877999 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-28fe4f3e-de4d-482e-aa55-a779737e4f72 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1689 microversion: 2.1 time: 0.157352 May 16 17:45:08.878790 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 297/617] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:08 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:45:09.433997 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-fdaec176-a70d-4ef9-85ca-5f4422ab4901 req-64f29093-2b0f-4b07-988e-8b100ca6c05b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "643ca394-14c0-407b-be2a-3616138ebdb6", "name": "network-vif-unplugged", "status": "completed", "tag": "d3d402b3-9560-4542-9028-c21ffae8c316"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:09.442527 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-fdaec176-a70d-4ef9-85ca-5f4422ab4901 req-64f29093-2b0f-4b07-988e-8b100ca6c05b service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:09.443023 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-fdaec176-a70d-4ef9-85ca-5f4422ab4901 req-64f29093-2b0f-4b07-988e-8b100ca6c05b service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:09.455022 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.compute.server_external_events [req-fdaec176-a70d-4ef9-85ca-5f4422ab4901 req-64f29093-2b0f-4b07-988e-8b100ca6c05b service nova] Unable to find a host for instance 643ca394-14c0-407b-be2a-3616138ebdb6. Dropping event network-vif-unplugged {{(pid=128815) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 16 17:45:09.455896 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-fdaec176-a70d-4ef9-85ca-5f4422ab4901 req-64f29093-2b0f-4b07-988e-8b100ca6c05b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025874 May 16 17:45:09.456530 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 321/618] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 16 17:45:09.770480 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-2954d991-b3b3-4d03-a779-8ec450b1b14c tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:09.771093 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-2954d991-b3b3-4d03-a779-8ec450b1b14c tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:09.777612 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2954d991-b3b3-4d03-a779-8ec450b1b14c tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:09.778070 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2954d991-b3b3-4d03-a779-8ec450b1b14c tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:09.778846 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2954d991-b3b3-4d03-a779-8ec450b1b14c tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:09.779316 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2954d991-b3b3-4d03-a779-8ec450b1b14c tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:09.908603 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-2954d991-b3b3-4d03-a779-8ec450b1b14c tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:09.917278 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-2954d991-b3b3-4d03-a779-8ec450b1b14c tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1517 microversion: 2.1 time: 0.150747 May 16 17:45:09.917901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 298/619] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:09 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:09.956582 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-aa149dd1-e89e-4176-a7ac-6f9a240b1807 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:09.957230 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-aa149dd1-e89e-4176-a7ac-6f9a240b1807 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:09.963507 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-aa149dd1-e89e-4176-a7ac-6f9a240b1807 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:09.963938 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-aa149dd1-e89e-4176-a7ac-6f9a240b1807 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:09.964694 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-aa149dd1-e89e-4176-a7ac-6f9a240b1807 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:09.965117 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-aa149dd1-e89e-4176-a7ac-6f9a240b1807 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:10.095071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-aa149dd1-e89e-4176-a7ac-6f9a240b1807 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:10.102585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-aa149dd1-e89e-4176-a7ac-6f9a240b1807 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1689 microversion: 2.1 time: 0.207517 May 16 17:45:10.103150 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 322/620] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:09 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1689 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:10.937608 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a10ec114-e2ed-4a14-838b-6a296ca01eb4 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:10.938689 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a10ec114-e2ed-4a14-838b-6a296ca01eb4 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:10.946578 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a10ec114-e2ed-4a14-838b-6a296ca01eb4 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:10.947031 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a10ec114-e2ed-4a14-838b-6a296ca01eb4 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:10.947799 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a10ec114-e2ed-4a14-838b-6a296ca01eb4 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:10.948239 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a10ec114-e2ed-4a14-838b-6a296ca01eb4 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:11.091104 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-a10ec114-e2ed-4a14-838b-6a296ca01eb4 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:11.103176 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a10ec114-e2ed-4a14-838b-6a296ca01eb4 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1517 microversion: 2.1 time: 0.171856 May 16 17:45:11.104119 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 299/621] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:10 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:11.127805 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-b7a73658-0d22-4960-80c8-36c7273b9f0e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:11.128411 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b7a73658-0d22-4960-80c8-36c7273b9f0e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:11.138346 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b7a73658-0d22-4960-80c8-36c7273b9f0e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:11.138822 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b7a73658-0d22-4960-80c8-36c7273b9f0e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:11.139926 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b7a73658-0d22-4960-80c8-36c7273b9f0e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:11.140522 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b7a73658-0d22-4960-80c8-36c7273b9f0e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:11.276197 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b7a73658-0d22-4960-80c8-36c7273b9f0e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:11.287943 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-b7a73658-0d22-4960-80c8-36c7273b9f0e tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1689 microversion: 2.1 time: 0.166185 May 16 17:45:11.288692 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 323/622] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:11 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:12.130333 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a28e67ff-2b06-4e84-9060-e5634d418091 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:12.131304 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a28e67ff-2b06-4e84-9060-e5634d418091 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:12.142467 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a28e67ff-2b06-4e84-9060-e5634d418091 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:12.143098 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a28e67ff-2b06-4e84-9060-e5634d418091 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:12.144167 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a28e67ff-2b06-4e84-9060-e5634d418091 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:12.144597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a28e67ff-2b06-4e84-9060-e5634d418091 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:12.301754 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-a28e67ff-2b06-4e84-9060-e5634d418091 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:12.308333 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-56f1d6e2-7996-4190-a4ba-4476ce8b2ff8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:12.309107 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-56f1d6e2-7996-4190-a4ba-4476ce8b2ff8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:12.310189 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a28e67ff-2b06-4e84-9060-e5634d418091 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1517 microversion: 2.1 time: 0.187591 May 16 17:45:12.310774 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 300/623] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:12 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1517 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:12.319484 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-56f1d6e2-7996-4190-a4ba-4476ce8b2ff8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:12.320239 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-56f1d6e2-7996-4190-a4ba-4476ce8b2ff8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:12.321029 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-56f1d6e2-7996-4190-a4ba-4476ce8b2ff8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:12.321462 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-56f1d6e2-7996-4190-a4ba-4476ce8b2ff8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:12.476492 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-56f1d6e2-7996-4190-a4ba-4476ce8b2ff8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:12.485078 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-56f1d6e2-7996-4190-a4ba-4476ce8b2ff8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1689 microversion: 2.1 time: 0.180621 May 16 17:45:12.485677 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 324/624] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:12 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:13.327066 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-fd4669d0-66a0-4854-909f-de4765a7d7bd tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:13.328305 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-fd4669d0-66a0-4854-909f-de4765a7d7bd tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:13.334923 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fd4669d0-66a0-4854-909f-de4765a7d7bd tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:13.335348 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fd4669d0-66a0-4854-909f-de4765a7d7bd tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:13.336114 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fd4669d0-66a0-4854-909f-de4765a7d7bd tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:13.336546 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fd4669d0-66a0-4854-909f-de4765a7d7bd tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:13.496282 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-fd4669d0-66a0-4854-909f-de4765a7d7bd tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:13.501881 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-bc4f045f-32c2-472e-9445-aaa2f63cbb8f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:13.502412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-bc4f045f-32c2-472e-9445-aaa2f63cbb8f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:13.504425 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-fd4669d0-66a0-4854-909f-de4765a7d7bd tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1519 microversion: 2.1 time: 0.180549 May 16 17:45:13.509270 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bc4f045f-32c2-472e-9445-aaa2f63cbb8f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:13.509783 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bc4f045f-32c2-472e-9445-aaa2f63cbb8f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:13.510561 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bc4f045f-32c2-472e-9445-aaa2f63cbb8f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:13.511046 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bc4f045f-32c2-472e-9445-aaa2f63cbb8f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:13.514556 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 301/625] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:13 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:13.648495 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-bc4f045f-32c2-472e-9445-aaa2f63cbb8f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:13.658194 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-bc4f045f-32c2-472e-9445-aaa2f63cbb8f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1689 microversion: 2.1 time: 0.160257 May 16 17:45:13.670315 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 325/626] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:13 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:45:14.113874 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-808d53bd-1ca9-4ca9-942a-b5cad96474bd tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb64405d-7d5a-41af-bae5-d345e5560f46"}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:14.115008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-808d53bd-1ca9-4ca9-942a-b5cad96474bd tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:14.121275 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-808d53bd-1ca9-4ca9-942a-b5cad96474bd tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:14.121965 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-808d53bd-1ca9-4ca9-942a-b5cad96474bd tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:14.122738 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-808d53bd-1ca9-4ca9-942a-b5cad96474bd tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:14.123303 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-808d53bd-1ca9-4ca9-942a-b5cad96474bd tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:14.207945 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-808d53bd-1ca9-4ca9-942a-b5cad96474bd tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] HTTP exception thrown: Invalid volume: volume cb64405d-7d5a-41af-bae5-d345e5560f46 is already attached to instances: 10f2449e-7706-405a-9dc2-3c52e3df0489 May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-808d53bd-1ca9-4ca9-942a-b5cad96474bd tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Request method failure captured: May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: POST /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489/os-volume_attachments HTTP/1.1 May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 74 May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigox4BWkjUGbMIvOn7lTkLppnWsYzIVQtNJHubTanufmvEHsiu_ONp3auIJGxAXU0K5GHn7jQDnT6YubbdzHrAJT45fAGoePZ3wwIuaMH8qkH2BLOah56kKB6Od9VwHk7uC0dRignIhl6Vtrx_s0xElsY95RDLsFnhdltcQlhJ0yFrss May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 80c60c24806542e889c070d519172e79 May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:45:14.209884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:45:14.211454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80c60c24806542e889c070d519172e79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80c60c24806542e889c070d519172e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:45:14.211454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:45:14.211454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 80c60c24806542e889c070d519172e79 May 16 17:45:14.211454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:45:14.211454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:45:14.211454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:45:14.211454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:45:14.211454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 6838738598ce4d2186e7c0b6547868f6 May 16 17:45:14.211454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:45:14.211454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: May 16 17:45:14.211454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {"volumeAttachment": {"volumeId": "cb64405d-7d5a-41af-bae5-d345e5560f46"}} May 16 17:45:14.211454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Invalid volume: volume cb64405d-7d5a-41af-bae5-d345e5560f46 is already attached to instances: 10f2449e-7706-405a-9dc2-3c52e3df0489 May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'server_id': '10f2449e-7706-405a-9dc2-3c52e3df0489', 'body': {'volumeAttachment': {'volumeId': 'cb64405d-7d5a-41af-bae5-d345e5560f46'}}} May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cb64405d-7d5a-41af-bae5-d345e5560f46 is already attached to instances: 10f2449e-7706-405a-9dc2-3c52e3df0489 May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:45:14.212306 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cb64405d-7d5a-41af-bae5-d345e5560f46 is already attached to instances: 10f2449e-7706-405a-9dc2-3c52e3df0489 May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:14.213696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:45:14.215361 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:45:14.215361 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:45:14.215361 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:45:14.215361 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cb64405d-7d5a-41af-bae5-d345e5560f46 is already attached to instances: 10f2449e-7706-405a-9dc2-3c52e3df0489 May 16 17:45:14.215361 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:45:14.215361 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-808d53bd-1ca9-4ca9-942a-b5cad96474bd tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Returning 400 to user: Invalid volume: volume cb64405d-7d5a-41af-bae5-d345e5560f46 is already attached to instances: 10f2449e-7706-405a-9dc2-3c52e3df0489 {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:45:14.215361 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-808d53bd-1ca9-4ca9-942a-b5cad96474bd tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "POST /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103428 May 16 17:45:14.215361 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 302/627] 10.222.0.58 () {60 vars in 1322 bytes} [Mon May 16 17:45:14 2022] POST /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 17:45:14.279681 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-4bb6acee-5e4f-4de0-b795-41941bc970e5 req-d8f964c8-7219-4042-acff-6ac9de4c0a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae780970-4212-46bc-8038-69067eb4e039", "name": "network-vif-deleted", "tag": "5942e31d-ecd1-4f97-9d8e-c38cb2323490"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:14.282485 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-618f4b65-8a9b-4a0a-ab7d-cd9cf5254e5e tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:14.283003 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-618f4b65-8a9b-4a0a-ab7d-cd9cf5254e5e tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:14.295161 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-4bb6acee-5e4f-4de0-b795-41941bc970e5 req-d8f964c8-7219-4042-acff-6ac9de4c0a49 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:14.295884 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-4bb6acee-5e4f-4de0-b795-41941bc970e5 req-d8f964c8-7219-4042-acff-6ac9de4c0a49 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:14.300267 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-618f4b65-8a9b-4a0a-ab7d-cd9cf5254e5e tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:14.300717 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-618f4b65-8a9b-4a0a-ab7d-cd9cf5254e5e tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:14.301493 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-618f4b65-8a9b-4a0a-ab7d-cd9cf5254e5e tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:14.301950 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-618f4b65-8a9b-4a0a-ab7d-cd9cf5254e5e tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:14.311655 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-4bb6acee-5e4f-4de0-b795-41941bc970e5 req-d8f964c8-7219-4042-acff-6ac9de4c0a49 service nova] Creating event network-vif-deleted:5942e31d-ecd1-4f97-9d8e-c38cb2323490 for instance ae780970-4212-46bc-8038-69067eb4e039 on hv-cinder-83769 May 16 17:45:14.318853 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-4bb6acee-5e4f-4de0-b795-41941bc970e5 req-d8f964c8-7219-4042-acff-6ac9de4c0a49 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113124 May 16 17:45:14.319927 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 326/628] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:45:14.430412 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-618f4b65-8a9b-4a0a-ab7d-cd9cf5254e5e tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lazy-loading 'services' on Instance uuid 10f2449e-7706-405a-9dc2-3c52e3df0489 {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:45:14.523380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5ca36c5e-ffc6-4a57-a803-5d2b5ccb608e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:14.524825 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-5ca36c5e-ffc6-4a57-a803-5d2b5ccb608e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:14.528451 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-618f4b65-8a9b-4a0a-ab7d-cd9cf5254e5e tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "DELETE /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489/os-volume_attachments/cb64405d-7d5a-41af-bae5-d345e5560f46" status: 202 len: 0 microversion: 2.1 time: 0.250550 May 16 17:45:14.529356 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 303/629] 10.222.0.58 () {58 vars in 1415 bytes} [Mon May 16 17:45:14 2022] DELETE /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489/os-volume_attachments/cb64405d-7d5a-41af-bae5-d345e5560f46 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:45:14.541498 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4a43a373-b540-4eb7-9f54-b64bb3ceac0b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:14.543635 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4a43a373-b540-4eb7-9f54-b64bb3ceac0b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:14.545133 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5ca36c5e-ffc6-4a57-a803-5d2b5ccb608e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:14.545650 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5ca36c5e-ffc6-4a57-a803-5d2b5ccb608e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:14.546781 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5ca36c5e-ffc6-4a57-a803-5d2b5ccb608e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:14.547562 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5ca36c5e-ffc6-4a57-a803-5d2b5ccb608e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:14.554090 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4a43a373-b540-4eb7-9f54-b64bb3ceac0b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:14.554885 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4a43a373-b540-4eb7-9f54-b64bb3ceac0b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:14.556410 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4a43a373-b540-4eb7-9f54-b64bb3ceac0b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:14.557029 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4a43a373-b540-4eb7-9f54-b64bb3ceac0b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:14.595167 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4a43a373-b540-4eb7-9f54-b64bb3ceac0b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061351 May 16 17:45:14.596628 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 304/630] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:45:14 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:45:14.677158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-159442a2-97ad-46cb-82e2-d4e8085f517f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:14.681291 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-159442a2-97ad-46cb-82e2-d4e8085f517f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:14.696916 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-159442a2-97ad-46cb-82e2-d4e8085f517f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:14.697619 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-159442a2-97ad-46cb-82e2-d4e8085f517f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:14.699890 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-159442a2-97ad-46cb-82e2-d4e8085f517f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:14.702109 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-159442a2-97ad-46cb-82e2-d4e8085f517f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:14.765758 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-5ca36c5e-ffc6-4a57-a803-5d2b5ccb608e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:14.782141 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-159442a2-97ad-46cb-82e2-d4e8085f517f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:14.783391 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-159442a2-97ad-46cb-82e2-d4e8085f517f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:14.783540 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-5ca36c5e-ffc6-4a57-a803-5d2b5ccb608e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1575 microversion: 2.1 time: 0.265191 May 16 17:45:14.784241 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-159442a2-97ad-46cb-82e2-d4e8085f517f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lazy-loading 'fault' on Instance uuid ae780970-4212-46bc-8038-69067eb4e039 {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:45:14.784771 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 327/631] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:14 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1575 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:14.856095 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-159442a2-97ad-46cb-82e2-d4e8085f517f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:14.863031 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-159442a2-97ad-46cb-82e2-d4e8085f517f tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 200 len: 1334 microversion: 2.1 time: 0.190061 May 16 17:45:14.863600 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 305/632] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:14 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 1334 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:15.607685 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-02e80744-b010-430e-a380-1cfaf3cd8868 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:15.608683 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-02e80744-b010-430e-a380-1cfaf3cd8868 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:15.615332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-02e80744-b010-430e-a380-1cfaf3cd8868 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:15.615784 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-02e80744-b010-430e-a380-1cfaf3cd8868 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:15.616556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-02e80744-b010-430e-a380-1cfaf3cd8868 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:15.616992 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-02e80744-b010-430e-a380-1cfaf3cd8868 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:15.645720 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-02e80744-b010-430e-a380-1cfaf3cd8868 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041997 May 16 17:45:15.646243 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 328/633] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:45:15 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 17:45:15.703763 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-6f7001a1-5b56-4fca-b404-360ed163aad5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:15.704275 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-6f7001a1-5b56-4fca-b404-360ed163aad5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:15.710858 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6f7001a1-5b56-4fca-b404-360ed163aad5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:15.711333 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6f7001a1-5b56-4fca-b404-360ed163aad5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:15.712085 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6f7001a1-5b56-4fca-b404-360ed163aad5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:15.712511 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6f7001a1-5b56-4fca-b404-360ed163aad5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:15.738460 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-6f7001a1-5b56-4fca-b404-360ed163aad5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Going to try to terminate instance {{(pid=128816) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:45:15.802303 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-52a04844-829a-448e-bbb1-296ac65631e5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:15.803032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-52a04844-829a-448e-bbb1-296ac65631e5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:15.810453 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-52a04844-829a-448e-bbb1-296ac65631e5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:15.810904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-52a04844-829a-448e-bbb1-296ac65631e5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:15.811670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-52a04844-829a-448e-bbb1-296ac65631e5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:15.812188 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-52a04844-829a-448e-bbb1-296ac65631e5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:15.824292 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-6f7001a1-5b56-4fca-b404-360ed163aad5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "DELETE /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 204 len: 0 microversion: 2.1 time: 0.124049 May 16 17:45:15.824883 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 306/634] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:45:15 2022] DELETE /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:45:15.833455 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c7ae737e-0d5e-4010-872a-cfe876eb16d6 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:15.834210 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-c7ae737e-0d5e-4010-872a-cfe876eb16d6 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:15.839815 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c7ae737e-0d5e-4010-872a-cfe876eb16d6 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:15.840271 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c7ae737e-0d5e-4010-872a-cfe876eb16d6 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:15.841033 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c7ae737e-0d5e-4010-872a-cfe876eb16d6 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:15.841463 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c7ae737e-0d5e-4010-872a-cfe876eb16d6 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:16.004271 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-52a04844-829a-448e-bbb1-296ac65631e5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:16.012018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-52a04844-829a-448e-bbb1-296ac65631e5 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1575 microversion: 2.1 time: 0.214700 May 16 17:45:16.012562 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 329/635] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:15 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:45:16.015365 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-c7ae737e-0d5e-4010-872a-cfe876eb16d6 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:16.017069 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d3fa7dc5-599c-4b79-a526-9ad23e864576 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:16.017719 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d3fa7dc5-599c-4b79-a526-9ad23e864576 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: ae780970-4212-46bc-8038-69067eb4e039] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:16.023256 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-c7ae737e-0d5e-4010-872a-cfe876eb16d6 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1681 microversion: 2.1 time: 0.193918 May 16 17:45:16.023480 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d3fa7dc5-599c-4b79-a526-9ad23e864576 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:16.023814 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 307/636] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:15 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1681 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:45:16.023946 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d3fa7dc5-599c-4b79-a526-9ad23e864576 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:16.024670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d3fa7dc5-599c-4b79-a526-9ad23e864576 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:16.025102 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d3fa7dc5-599c-4b79-a526-9ad23e864576 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:16.038553 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-d3fa7dc5-599c-4b79-a526-9ad23e864576 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] HTTP exception thrown: Instance ae780970-4212-46bc-8038-69067eb4e039 could not be found. May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d3fa7dc5-599c-4b79-a526-9ad23e864576 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Request method failure captured: May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 HTTP/1.1 May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigox3Qmb4992kn72mY0kZabi3WWaMoKtsNJ81h1vGTu6lqq_JffhZxwNoadReBgNHMCVOBH4NrH9XXgD7nYDL--nkddztfIg0jyy7tVCW5L3LondFz79JY-50aJZtbJok48vYOP6Nqc0oTFz5yi_gn8jJF0uyZpp_zS0drwvaV5rtuvk May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 1eddf9ae85b940b8bd556f4cf66c0b79 May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1737598232 May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:45:16.040184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:45:16.042228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eddf9ae85b940b8bd556f4cf66c0b79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1eddf9ae85b940b8bd556f4cf66c0b79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1eddf9ae85b940b8bd556f4cf66c0b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eddf9ae85b940b8bd556f4cf66c0b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:45:16.042228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1737598232 May 16 17:45:16.042228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 1eddf9ae85b940b8bd556f4cf66c0b79 May 16 17:45:16.042228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1737598232 May 16 17:45:16.042228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-ServerRescueNegativeTestJSON-1737598232-project May 16 17:45:16.042228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:45:16.042228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:45:16.042228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: c482d82afb734e10a5a11070fcb5f736 May 16 17:45:16.042228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1737598232-project May 16 17:45:16.042228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:45:16.042228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance ae780970-4212-46bc-8038-69067eb4e039 could not be found. May 16 17:45:16.042228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': 'ae780970-4212-46bc-8038-69067eb4e039'} May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae780970-4212-46bc-8038-69067eb4e039 could not be found. May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:45:16.043135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:45:16.044458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:45:16.044458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:45:16.044458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:45:16.044458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:45:16.044458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:45:16.044458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:45:16.044458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:45:16.044458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae780970-4212-46bc-8038-69067eb4e039 could not be found. May 16 17:45:16.044458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:16.044458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:45:16.044458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:16.044458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:16.044458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:45:16.044458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:45:16.044458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:45:16.044458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:45:16.044458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae780970-4212-46bc-8038-69067eb4e039 could not be found. May 16 17:45:16.044458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:16.045841 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d3fa7dc5-599c-4b79-a526-9ad23e864576 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Returning 404 to user: Instance ae780970-4212-46bc-8038-69067eb4e039 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:45:16.045841 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d3fa7dc5-599c-4b79-a526-9ad23e864576 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039" status: 404 len: 111 microversion: 2.1 time: 0.028443 May 16 17:45:16.045841 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 330/637] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:16 2022] GET /compute/v2.1/servers/ae780970-4212-46bc-8038-69067eb4e039 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:45:16.050732 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-5aa3bfd5-3301-4b0f-a85f-38d767cd6098 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '.version_select at 0x7f79a4873a60>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:16.068678 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-5aa3bfd5-3301-4b0f-a85f-38d767cd6098 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-905877989" status: 202 len: 0 microversion: 2.1 time: 0.021442 May 16 17:45:16.069732 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 308/638] 10.222.0.58 () {58 vars in 1217 bytes} [Mon May 16 17:45:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-905877989 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 17:45:17.029108 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-81b3bf09-b9bc-4413-b0ab-9bab9e7c7ac9 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:17.029765 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-81b3bf09-b9bc-4413-b0ab-9bab9e7c7ac9 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:17.036898 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-81b3bf09-b9bc-4413-b0ab-9bab9e7c7ac9 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:17.037366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-81b3bf09-b9bc-4413-b0ab-9bab9e7c7ac9 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:17.038330 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-81b3bf09-b9bc-4413-b0ab-9bab9e7c7ac9 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:17.038926 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-81b3bf09-b9bc-4413-b0ab-9bab9e7c7ac9 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:17.041637 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-52f52f09-4eae-4b30-a268-7ced631b0cdc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:17.042259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-52f52f09-4eae-4b30-a268-7ced631b0cdc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:17.048949 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-52f52f09-4eae-4b30-a268-7ced631b0cdc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:17.049393 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-52f52f09-4eae-4b30-a268-7ced631b0cdc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:17.050247 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-52f52f09-4eae-4b30-a268-7ced631b0cdc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:17.050656 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-52f52f09-4eae-4b30-a268-7ced631b0cdc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:17.232002 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-81b3bf09-b9bc-4413-b0ab-9bab9e7c7ac9 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:17.235875 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-52f52f09-4eae-4b30-a268-7ced631b0cdc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:17.240115 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-81b3bf09-b9bc-4413-b0ab-9bab9e7c7ac9 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1575 microversion: 2.1 time: 0.215070 May 16 17:45:17.240690 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 331/639] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:17 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:17.244142 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-52f52f09-4eae-4b30-a268-7ced631b0cdc tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1681 microversion: 2.1 time: 0.207301 May 16 17:45:17.244688 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 309/640] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:17 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1681 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:45:18.256958 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-2c626e82-b9f1-4004-81e6-2a43ddbb5376 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:18.258240 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-2c626e82-b9f1-4004-81e6-2a43ddbb5376 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:18.261062 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b496cf1b-34b2-4eef-a9b3-905da59055c1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:18.261709 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b496cf1b-34b2-4eef-a9b3-905da59055c1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:18.265458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2c626e82-b9f1-4004-81e6-2a43ddbb5376 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:18.266173 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2c626e82-b9f1-4004-81e6-2a43ddbb5376 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:18.267165 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2c626e82-b9f1-4004-81e6-2a43ddbb5376 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:18.267592 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2c626e82-b9f1-4004-81e6-2a43ddbb5376 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:18.268078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b496cf1b-34b2-4eef-a9b3-905da59055c1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:18.268531 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b496cf1b-34b2-4eef-a9b3-905da59055c1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:18.269296 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b496cf1b-34b2-4eef-a9b3-905da59055c1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:18.269773 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b496cf1b-34b2-4eef-a9b3-905da59055c1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:18.470495 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-2c626e82-b9f1-4004-81e6-2a43ddbb5376 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:18.477253 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-b496cf1b-34b2-4eef-a9b3-905da59055c1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:18.478239 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-2c626e82-b9f1-4004-81e6-2a43ddbb5376 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1575 microversion: 2.1 time: 0.225644 May 16 17:45:18.479012 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 332/641] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:18 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1575 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:18.484751 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b496cf1b-34b2-4eef-a9b3-905da59055c1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1681 microversion: 2.1 time: 0.227499 May 16 17:45:18.485309 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 310/642] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:18 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1681 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:45:18.863548 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-be7ac826-a37c-454f-b2c9-aac2ee197750 req-915c9d52-c734-4815-8144-fe1b624768db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f2449e-7706-405a-9dc2-3c52e3df0489", "name": "network-vif-deleted", "tag": "36a356f3-2d74-47dd-9eae-4601aa39ccb1"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:18.872164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-be7ac826-a37c-454f-b2c9-aac2ee197750 req-915c9d52-c734-4815-8144-fe1b624768db service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:18.872684 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-be7ac826-a37c-454f-b2c9-aac2ee197750 req-915c9d52-c734-4815-8144-fe1b624768db service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:18.884609 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-be7ac826-a37c-454f-b2c9-aac2ee197750 req-915c9d52-c734-4815-8144-fe1b624768db service nova] Creating event network-vif-deleted:36a356f3-2d74-47dd-9eae-4601aa39ccb1 for instance 10f2449e-7706-405a-9dc2-3c52e3df0489 on hv-cinder-83769 May 16 17:45:18.890095 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-be7ac826-a37c-454f-b2c9-aac2ee197750 req-915c9d52-c734-4815-8144-fe1b624768db service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030211 May 16 17:45:18.894112 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 333/643] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:45:18.981222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-0e9a54f1-0d27-4156-9b3f-71ca2533cad3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:18.981758 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-0e9a54f1-0d27-4156-9b3f-71ca2533cad3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:18.988089 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0e9a54f1-0d27-4156-9b3f-71ca2533cad3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:18.988794 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0e9a54f1-0d27-4156-9b3f-71ca2533cad3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:18.989890 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0e9a54f1-0d27-4156-9b3f-71ca2533cad3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:18.990334 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0e9a54f1-0d27-4156-9b3f-71ca2533cad3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:19.020796 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-0e9a54f1-0d27-4156-9b3f-71ca2533cad3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Going to try to terminate instance {{(pid=128816) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:45:19.103416 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-0e9a54f1-0d27-4156-9b3f-71ca2533cad3 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 204 len: 0 microversion: 2.1 time: 0.125770 May 16 17:45:19.103965 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 311/644] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:45:18 2022] DELETE /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:45:19.112754 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-af14819d-1e7b-4b00-aee1-b5dd1d213cae tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:19.113457 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-af14819d-1e7b-4b00-aee1-b5dd1d213cae tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:19.119769 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-af14819d-1e7b-4b00-aee1-b5dd1d213cae tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:19.120221 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-af14819d-1e7b-4b00-aee1-b5dd1d213cae tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:19.121001 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-af14819d-1e7b-4b00-aee1-b5dd1d213cae tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:19.121435 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-af14819d-1e7b-4b00-aee1-b5dd1d213cae tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:19.263992 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-af14819d-1e7b-4b00-aee1-b5dd1d213cae tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:19.271901 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-af14819d-1e7b-4b00-aee1-b5dd1d213cae tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1507 microversion: 2.1 time: 0.163577 May 16 17:45:19.272482 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 334/645] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:19 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:19.497402 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-774bb539-23ca-4992-82b1-0c8a2fa58478 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:19.497402 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-774bb539-23ca-4992-82b1-0c8a2fa58478 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:19.503126 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-cd24d40f-42c2-46a5-9580-b9ec62ebe08b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:19.504171 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-cd24d40f-42c2-46a5-9580-b9ec62ebe08b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:19.507001 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-774bb539-23ca-4992-82b1-0c8a2fa58478 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:19.507553 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-774bb539-23ca-4992-82b1-0c8a2fa58478 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:19.508827 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-774bb539-23ca-4992-82b1-0c8a2fa58478 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:19.509324 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-774bb539-23ca-4992-82b1-0c8a2fa58478 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:19.511535 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cd24d40f-42c2-46a5-9580-b9ec62ebe08b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:19.512011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cd24d40f-42c2-46a5-9580-b9ec62ebe08b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:19.512794 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cd24d40f-42c2-46a5-9580-b9ec62ebe08b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:19.513490 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cd24d40f-42c2-46a5-9580-b9ec62ebe08b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:19.553217 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cd24d40f-42c2-46a5-9580-b9ec62ebe08b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:19.554009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cd24d40f-42c2-46a5-9580-b9ec62ebe08b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:19.555234 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.objects.instance [None req-cd24d40f-42c2-46a5-9580-b9ec62ebe08b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lazy-loading 'fault' on Instance uuid 10f2449e-7706-405a-9dc2-3c52e3df0489 {{(pid=128815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:45:19.622384 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-cd24d40f-42c2-46a5-9580-b9ec62ebe08b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:19.631037 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-cd24d40f-42c2-46a5-9580-b9ec62ebe08b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1331 microversion: 2.1 time: 0.132323 May 16 17:45:19.631597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 335/646] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:19 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1331 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:19.689592 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-774bb539-23ca-4992-82b1-0c8a2fa58478 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:19.698800 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-774bb539-23ca-4992-82b1-0c8a2fa58478 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1575 microversion: 2.1 time: 0.206631 May 16 17:45:19.699393 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 312/647] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:19 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:20.288491 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-40ee1fc1-ff1b-4294-9d1c-c41067e7e8ee tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:20.289106 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-40ee1fc1-ff1b-4294-9d1c-c41067e7e8ee tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:20.296158 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-40ee1fc1-ff1b-4294-9d1c-c41067e7e8ee tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:20.296604 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-40ee1fc1-ff1b-4294-9d1c-c41067e7e8ee tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:20.297370 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-40ee1fc1-ff1b-4294-9d1c-c41067e7e8ee tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:20.297833 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-40ee1fc1-ff1b-4294-9d1c-c41067e7e8ee tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:20.432588 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-40ee1fc1-ff1b-4294-9d1c-c41067e7e8ee tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:20.441321 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-40ee1fc1-ff1b-4294-9d1c-c41067e7e8ee tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1507 microversion: 2.1 time: 0.156768 May 16 17:45:20.442086 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 336/648] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:20 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:20.647441 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-75751353-b1ed-40c7-a8d8-8e105bd28ad0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:20.648072 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-75751353-b1ed-40c7-a8d8-8e105bd28ad0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:20.654961 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-75751353-b1ed-40c7-a8d8-8e105bd28ad0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:20.655406 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-75751353-b1ed-40c7-a8d8-8e105bd28ad0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:20.656179 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-75751353-b1ed-40c7-a8d8-8e105bd28ad0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:20.656617 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-75751353-b1ed-40c7-a8d8-8e105bd28ad0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:20.688936 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-75751353-b1ed-40c7-a8d8-8e105bd28ad0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:20.689390 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-75751353-b1ed-40c7-a8d8-8e105bd28ad0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:20.689845 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-75751353-b1ed-40c7-a8d8-8e105bd28ad0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lazy-loading 'fault' on Instance uuid 10f2449e-7706-405a-9dc2-3c52e3df0489 {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:45:20.720879 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-1b7989dc-1e39-4592-be70-8a0b4e189e6f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:20.721516 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-1b7989dc-1e39-4592-be70-8a0b4e189e6f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:20.727494 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1b7989dc-1e39-4592-be70-8a0b4e189e6f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:20.728277 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1b7989dc-1e39-4592-be70-8a0b4e189e6f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:20.729063 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1b7989dc-1e39-4592-be70-8a0b4e189e6f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:20.729499 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1b7989dc-1e39-4592-be70-8a0b4e189e6f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:20.735078 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-75751353-b1ed-40c7-a8d8-8e105bd28ad0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:20.742564 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-75751353-b1ed-40c7-a8d8-8e105bd28ad0 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 200 len: 1331 microversion: 2.1 time: 0.098949 May 16 17:45:20.743346 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 313/649] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:20 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:20.875693 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-1b7989dc-1e39-4592-be70-8a0b4e189e6f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:20.883346 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-1b7989dc-1e39-4592-be70-8a0b4e189e6f tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1575 microversion: 2.1 time: 0.168351 May 16 17:45:20.883912 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 337/650] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:20 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:45:21.458913 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a1942b27-9877-4e6f-8e8e-474ca4cf4553 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:21.459522 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a1942b27-9877-4e6f-8e8e-474ca4cf4553 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:21.465791 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a1942b27-9877-4e6f-8e8e-474ca4cf4553 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:21.466245 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a1942b27-9877-4e6f-8e8e-474ca4cf4553 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:21.467011 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a1942b27-9877-4e6f-8e8e-474ca4cf4553 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:21.467445 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a1942b27-9877-4e6f-8e8e-474ca4cf4553 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:21.563672 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-b6643f5d-ea28-4bf6-b9a5-19cc3c5776a7 req-1e61690a-ecb2-4f11-a94a-640bb5786b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "643ca394-14c0-407b-be2a-3616138ebdb6", "name": "network-vif-plugged", "status": "completed", "tag": "d3d402b3-9560-4542-9028-c21ffae8c316"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:21.578673 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-b6643f5d-ea28-4bf6-b9a5-19cc3c5776a7 req-1e61690a-ecb2-4f11-a94a-640bb5786b93 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:21.580094 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-b6643f5d-ea28-4bf6-b9a5-19cc3c5776a7 req-1e61690a-ecb2-4f11-a94a-640bb5786b93 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:21.593712 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-b6643f5d-ea28-4bf6-b9a5-19cc3c5776a7 req-1e61690a-ecb2-4f11-a94a-640bb5786b93 service nova] Creating event network-vif-plugged:d3d402b3-9560-4542-9028-c21ffae8c316 for instance 643ca394-14c0-407b-be2a-3616138ebdb6 on hv-cinder-83769 May 16 17:45:21.599427 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-b6643f5d-ea28-4bf6-b9a5-19cc3c5776a7 req-1e61690a-ecb2-4f11-a94a-640bb5786b93 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040503 May 16 17:45:21.600783 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 338/651] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:45:21.617946 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-a1942b27-9877-4e6f-8e8e-474ca4cf4553 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:21.629190 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a1942b27-9877-4e6f-8e8e-474ca4cf4553 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1507 microversion: 2.1 time: 0.174151 May 16 17:45:21.630642 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 314/652] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:21 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:21.761373 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0081ca2c-6b61-4326-a9d4-5e379b5e554a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:21.762082 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-0081ca2c-6b61-4326-a9d4-5e379b5e554a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:21.776969 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0081ca2c-6b61-4326-a9d4-5e379b5e554a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:21.777422 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0081ca2c-6b61-4326-a9d4-5e379b5e554a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:21.778239 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0081ca2c-6b61-4326-a9d4-5e379b5e554a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:21.778870 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0081ca2c-6b61-4326-a9d4-5e379b5e554a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:21.793128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-0081ca2c-6b61-4326-a9d4-5e379b5e554a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] HTTP exception thrown: Instance 10f2449e-7706-405a-9dc2-3c52e3df0489 could not be found. May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0081ca2c-6b61-4326-a9d4-5e379b5e554a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Request method failure captured: May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 HTTP/1.1 May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigox4BWkjUGbMIvOn7lTkLppnWsYzIVQtNJHubTanufmvEHsiu_ONp3auIJGxAXU0K5GHn7jQDnT6YubbdzHrAJT45fAGoePZ3wwIuaMH8qkH2BLOah56kKB6Od9VwHk7uC0dRignIhl6Vtrx_s0xElsY95RDLsFnhdltcQlhJ0yFrss May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 80c60c24806542e889c070d519172e79 May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:45:21.794848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:45:21.796171 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80c60c24806542e889c070d519172e79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80c60c24806542e889c070d519172e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:45:21.796171 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:45:21.796171 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 80c60c24806542e889c070d519172e79 May 16 17:45:21.796171 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:45:21.796171 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:45:21.796171 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:45:21.796171 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:45:21.796171 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: 6838738598ce4d2186e7c0b6547868f6 May 16 17:45:21.796171 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:45:21.796171 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:45:21.796171 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance 10f2449e-7706-405a-9dc2-3c52e3df0489 could not be found. May 16 17:45:21.796171 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': '10f2449e-7706-405a-9dc2-3c52e3df0489'} May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10f2449e-7706-405a-9dc2-3c52e3df0489 could not be found. May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:45:21.796954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:45:21.799260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:45:21.799260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:45:21.799260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:45:21.799260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:45:21.799260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:45:21.799260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:45:21.799260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:45:21.799260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10f2449e-7706-405a-9dc2-3c52e3df0489 could not be found. May 16 17:45:21.799260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:21.799260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:45:21.799260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:21.799260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:21.799260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:45:21.799260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:45:21.799260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:45:21.799260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:45:21.799260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10f2449e-7706-405a-9dc2-3c52e3df0489 could not be found. May 16 17:45:21.799260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:21.800439 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0081ca2c-6b61-4326-a9d4-5e379b5e554a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Returning 404 to user: Instance 10f2449e-7706-405a-9dc2-3c52e3df0489 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:45:21.800439 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-0081ca2c-6b61-4326-a9d4-5e379b5e554a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 404 len: 111 microversion: 2.1 time: 0.039478 May 16 17:45:21.800439 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 339/653] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:21 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:45:21.805692 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-eb213b7e-86f1-46b1-9f96-562666b60fbe tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '.version_select at 0x7f79a4817310>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:21.825154 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-eb213b7e-86f1-46b1-9f96-562666b60fbe tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-641678839" status: 202 len: 0 microversion: 2.1 time: 0.023440 May 16 17:45:21.826494 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 315/654] 10.222.0.58 () {58 vars in 1217 bytes} [Mon May 16 17:45:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-641678839 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:45:21.902076 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8dae24ab-c6ed-4100-919d-941bf081270b tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:21.902904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-8dae24ab-c6ed-4100-919d-941bf081270b tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:21.910750 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8dae24ab-c6ed-4100-919d-941bf081270b tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:21.911378 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8dae24ab-c6ed-4100-919d-941bf081270b tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:21.912343 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8dae24ab-c6ed-4100-919d-941bf081270b tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:21.912920 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8dae24ab-c6ed-4100-919d-941bf081270b tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:21.926366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-b061ec74-777d-4b9d-929a-e4d89a381c92 req-9a16e372-fd47-4c7c-b06b-b34c6120ca6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8ac2f4d-715e-4f43-b3fd-1766c17850b9", "name": "network-vif-deleted", "tag": "90aff3c1-0c10-404b-852f-cb00af0b6710"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:21.946660 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-b061ec74-777d-4b9d-929a-e4d89a381c92 req-9a16e372-fd47-4c7c-b06b-b34c6120ca6b service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:21.947141 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-b061ec74-777d-4b9d-929a-e4d89a381c92 req-9a16e372-fd47-4c7c-b06b-b34c6120ca6b service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:21.980383 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-b061ec74-777d-4b9d-929a-e4d89a381c92 req-9a16e372-fd47-4c7c-b06b-b34c6120ca6b service nova] Creating event network-vif-deleted:90aff3c1-0c10-404b-852f-cb00af0b6710 for instance d8ac2f4d-715e-4f43-b3fd-1766c17850b9 on hv-cinder-83769 May 16 17:45:21.993128 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-b061ec74-777d-4b9d-929a-e4d89a381c92 req-9a16e372-fd47-4c7c-b06b-b34c6120ca6b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070442 May 16 17:45:21.995721 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 316/655] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:45:22.138983 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-8dae24ab-c6ed-4100-919d-941bf081270b tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:22.165571 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-8dae24ab-c6ed-4100-919d-941bf081270b tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1575 microversion: 2.1 time: 0.268877 May 16 17:45:22.166712 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 340/656] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:21 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1575 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:22.621688 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-6e19fc6d-0837-4175-ba9d-dcbf5ff8a28f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Action: 'create', calling method: .version_select at 0x7f79a48650d0>, body: {"keypair": {"name": "tempest-keypair-1355114172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiG9AR/KNJRqgLItjOdUvwaAvRDEkNysy24QFMwiQ7fU2/otrC72EveC69pGwfsIWwbUnSxb60FC3dEMMvNAMJfwY5wTzsrSWn0H0lNy/YmlEgm9fONy0Xq5hOXVEC3cQ=="}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:22.635849 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-6e19fc6d-0837-4175-ba9d-dcbf5ff8a28f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Getting quotas for project 80c60c24806542e889c070d519172e79. Resources: {'key_pairs'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:45:22.639648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-6e19fc6d-0837-4175-ba9d-dcbf5ff8a28f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Getting quotas for user 6838738598ce4d2186e7c0b6547868f6 and project 80c60c24806542e889c070d519172e79. Resources: {'key_pairs'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:45:22.646980 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e079f2c8-b887-4d58-83c7-91483d32d308 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:22.647618 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-e079f2c8-b887-4d58-83c7-91483d32d308 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:22.654412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e079f2c8-b887-4d58-83c7-91483d32d308 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:22.654862 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e079f2c8-b887-4d58-83c7-91483d32d308 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:22.655687 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e079f2c8-b887-4d58-83c7-91483d32d308 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:22.656043 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e079f2c8-b887-4d58-83c7-91483d32d308 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:22.663377 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-6e19fc6d-0837-4175-ba9d-dcbf5ff8a28f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046010 May 16 17:45:22.663974 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 317/657] 10.222.0.58 () {60 vars in 1158 bytes} [Mon May 16 17:45:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:45:22.688888 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e079f2c8-b887-4d58-83c7-91483d32d308 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:22.689305 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e079f2c8-b887-4d58-83c7-91483d32d308 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:22.689788 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.objects.instance [None req-e079f2c8-b887-4d58-83c7-91483d32d308 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lazy-loading 'fault' on Instance uuid d8ac2f4d-715e-4f43-b3fd-1766c17850b9 {{(pid=128815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:45:22.733389 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-e079f2c8-b887-4d58-83c7-91483d32d308 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:22.741147 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-e079f2c8-b887-4d58-83c7-91483d32d308 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 200 len: 1311 microversion: 2.1 time: 0.098426 May 16 17:45:22.745604 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 341/658] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:22 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:23.183416 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d3d90453-96d7-4d87-9d8a-d273f514f169 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:23.185022 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d3d90453-96d7-4d87-9d8a-d273f514f169 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:23.191607 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d3d90453-96d7-4d87-9d8a-d273f514f169 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:23.192332 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d3d90453-96d7-4d87-9d8a-d273f514f169 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:23.193362 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d3d90453-96d7-4d87-9d8a-d273f514f169 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:23.194030 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d3d90453-96d7-4d87-9d8a-d273f514f169 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:23.400622 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d3d90453-96d7-4d87-9d8a-d273f514f169 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:23.408271 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d3d90453-96d7-4d87-9d8a-d273f514f169 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1562 microversion: 2.1 time: 0.229365 May 16 17:45:23.408882 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 318/659] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:23 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:23.758989 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-971d7177-1bbc-4362-bee6-210f07e3972c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:23.759584 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-971d7177-1bbc-4362-bee6-210f07e3972c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: d8ac2f4d-715e-4f43-b3fd-1766c17850b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:23.765765 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-971d7177-1bbc-4362-bee6-210f07e3972c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:23.766211 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-971d7177-1bbc-4362-bee6-210f07e3972c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:23.766973 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-971d7177-1bbc-4362-bee6-210f07e3972c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:23.767404 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-971d7177-1bbc-4362-bee6-210f07e3972c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:23.781043 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-971d7177-1bbc-4362-bee6-210f07e3972c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] HTTP exception thrown: Instance d8ac2f4d-715e-4f43-b3fd-1766c17850b9 could not be found. May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-971d7177-1bbc-4362-bee6-210f07e3972c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Request method failure captured: May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 HTTP/1.1 May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigox3Qmb4992kn72mY0kZabi3WWaMoKtsNJ81h1vGTu6lqq_JffhZxwNoadReBgNHMCVOBH4NrH9XXgD7nYDL--nkddztfIg0jyy7tVCW5L3LondFz79JY-50aJZtbJok48vYOP6Nqc0oTFz5yi_gn8jJF0uyZpp_zS0drwvaV5rtuvk May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 1eddf9ae85b940b8bd556f4cf66c0b79 May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1737598232 May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:45:23.782608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:45:23.783992 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eddf9ae85b940b8bd556f4cf66c0b79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1eddf9ae85b940b8bd556f4cf66c0b79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1eddf9ae85b940b8bd556f4cf66c0b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eddf9ae85b940b8bd556f4cf66c0b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:45:23.783992 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1737598232 May 16 17:45:23.783992 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 1eddf9ae85b940b8bd556f4cf66c0b79 May 16 17:45:23.783992 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1737598232 May 16 17:45:23.783992 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-ServerRescueNegativeTestJSON-1737598232-project May 16 17:45:23.783992 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:45:23.783992 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:45:23.783992 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: c482d82afb734e10a5a11070fcb5f736 May 16 17:45:23.783992 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1737598232-project May 16 17:45:23.783992 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:45:23.783992 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance d8ac2f4d-715e-4f43-b3fd-1766c17850b9 could not be found. May 16 17:45:23.783992 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': 'd8ac2f4d-715e-4f43-b3fd-1766c17850b9'} May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8ac2f4d-715e-4f43-b3fd-1766c17850b9 could not be found. May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:45:23.784949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:45:23.786314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:45:23.786314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:45:23.786314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:45:23.786314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:45:23.786314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:45:23.786314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:45:23.786314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:45:23.786314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8ac2f4d-715e-4f43-b3fd-1766c17850b9 could not be found. May 16 17:45:23.786314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:23.786314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:45:23.786314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:23.786314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:23.786314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:45:23.786314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:45:23.786314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:45:23.786314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:45:23.786314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8ac2f4d-715e-4f43-b3fd-1766c17850b9 could not be found. May 16 17:45:23.786314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:23.787882 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-971d7177-1bbc-4362-bee6-210f07e3972c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Returning 404 to user: Instance d8ac2f4d-715e-4f43-b3fd-1766c17850b9 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:45:23.787882 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-971d7177-1bbc-4362-bee6-210f07e3972c tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9" status: 404 len: 111 microversion: 2.1 time: 0.029390 May 16 17:45:23.787882 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 342/660] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:23 2022] GET /compute/v2.1/servers/d8ac2f4d-715e-4f43-b3fd-1766c17850b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:45:23.793048 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-397f5eef-a0f0-43f0-9f94-36a73c3a96bf tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:23.793564 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-397f5eef-a0f0-43f0-9f94-36a73c3a96bf tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:23.799759 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-397f5eef-a0f0-43f0-9f94-36a73c3a96bf tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:23.800208 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-397f5eef-a0f0-43f0-9f94-36a73c3a96bf tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:23.800976 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-397f5eef-a0f0-43f0-9f94-36a73c3a96bf tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:23.801510 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-397f5eef-a0f0-43f0-9f94-36a73c3a96bf tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:23.826014 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-397f5eef-a0f0-43f0-9f94-36a73c3a96bf tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Going to try to terminate instance {{(pid=128816) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:45:23.915122 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-397f5eef-a0f0-43f0-9f94-36a73c3a96bf tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 204 len: 0 microversion: 2.1 time: 0.125495 May 16 17:45:23.915377 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 319/661] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:45:23 2022] DELETE /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:45:23.924344 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-501dc014-fa86-4c41-a188-b17f14859748 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:23.925288 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-501dc014-fa86-4c41-a188-b17f14859748 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:23.931819 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-501dc014-fa86-4c41-a188-b17f14859748 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:23.932301 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-501dc014-fa86-4c41-a188-b17f14859748 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:23.933083 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-501dc014-fa86-4c41-a188-b17f14859748 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:23.933584 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-501dc014-fa86-4c41-a188-b17f14859748 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:24.077691 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-501dc014-fa86-4c41-a188-b17f14859748 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:24.085527 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-501dc014-fa86-4c41-a188-b17f14859748 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.165601 May 16 17:45:24.086271 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 343/662] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:23 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:24.442230 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-67718b65-0fda-4d66-8fc0-02eeda722d40 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1031711464", "imageRef": "782bd628-ef1b-419c-99f5-2c312d1766a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28ed5c22-d613-46a9-98e4-5aa888da0e5a"}], "security_groups": [{"name": "tempest-securitygroup--87237182"}], "key_name": "tempest-keypair-1355114172", "user_data": "}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:24.547214 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.network.neutron [None req-67718b65-0fda-4d66-8fc0-02eeda722d40 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] validate_networks() for [('28ed5c22-d613-46a9-98e4-5aa888da0e5a', None, None, None, None, None)] {{(pid=128816) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:45:25.103260 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-9eee73ab-9af1-43b4-840b-5bf8d61d0794 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:25.103852 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-9eee73ab-9af1-43b4-840b-5bf8d61d0794 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:25.111139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9eee73ab-9af1-43b4-840b-5bf8d61d0794 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:25.111591 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9eee73ab-9af1-43b4-840b-5bf8d61d0794 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:25.112391 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9eee73ab-9af1-43b4-840b-5bf8d61d0794 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:25.112832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9eee73ab-9af1-43b4-840b-5bf8d61d0794 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:25.438792 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-9eee73ab-9af1-43b4-840b-5bf8d61d0794 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:25.446768 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-9eee73ab-9af1-43b4-840b-5bf8d61d0794 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.347508 May 16 17:45:25.447364 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 344/663] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:25 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:25.467182 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-67718b65-0fda-4d66-8fc0-02eeda722d40 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Flavor limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:45:25.467699 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-67718b65-0fda-4d66-8fc0-02eeda722d40 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Image limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:45:25.468236 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-67718b65-0fda-4d66-8fc0-02eeda722d40 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Flavor pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:45:25.468776 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-67718b65-0fda-4d66-8fc0-02eeda722d40 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Image pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:45:25.469299 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-67718b65-0fda-4d66-8fc0-02eeda722d40 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:45:25.482510 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-67718b65-0fda-4d66-8fc0-02eeda722d40 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:25.483118 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-67718b65-0fda-4d66-8fc0-02eeda722d40 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:25.484345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-67718b65-0fda-4d66-8fc0-02eeda722d40 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:25.484871 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-67718b65-0fda-4d66-8fc0-02eeda722d40 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:25.503943 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-67718b65-0fda-4d66-8fc0-02eeda722d40 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Getting quotas for project 80c60c24806542e889c070d519172e79. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:45:25.508339 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-67718b65-0fda-4d66-8fc0-02eeda722d40 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Getting quotas for user 6838738598ce4d2186e7c0b6547868f6 and project 80c60c24806542e889c070d519172e79. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:45:25.520081 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-67718b65-0fda-4d66-8fc0-02eeda722d40 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Going to run 1 instances... {{(pid=128816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:45:25.522530 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-67718b65-0fda-4d66-8fc0-02eeda722d40 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='782bd628-ef1b-419c-99f5-2c312d1766a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:45:25.579576 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-67718b65-0fda-4d66-8fc0-02eeda722d40 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.141675 May 16 17:45:25.580398 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 320/664] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:45:24 2022] POST /compute/v2.1/servers => generated 400 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:45:25.590854 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-3a8c1e16-7ffd-4c2e-bf78-a9cfcd960b32 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:25.591468 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-3a8c1e16-7ffd-4c2e-bf78-a9cfcd960b32 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:25.646449 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3a8c1e16-7ffd-4c2e-bf78-a9cfcd960b32 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:25.653229 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-3a8c1e16-7ffd-4c2e-bf78-a9cfcd960b32 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f" status: 200 len: 1242 microversion: 2.1 time: 0.066467 May 16 17:45:25.663012 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 345/665] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:25 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:26.465083 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a9e74f3f-c66e-4401-8f11-76fecb30e401 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:26.465592 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a9e74f3f-c66e-4401-8f11-76fecb30e401 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:26.471911 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a9e74f3f-c66e-4401-8f11-76fecb30e401 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:26.472550 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a9e74f3f-c66e-4401-8f11-76fecb30e401 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:26.473202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a9e74f3f-c66e-4401-8f11-76fecb30e401 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:26.473662 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a9e74f3f-c66e-4401-8f11-76fecb30e401 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:26.610230 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-a9e74f3f-c66e-4401-8f11-76fecb30e401 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:26.618228 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a9e74f3f-c66e-4401-8f11-76fecb30e401 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1521 microversion: 2.1 time: 0.157768 May 16 17:45:26.618794 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 321/666] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:26 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:26.673074 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f5c9e44f-010e-47ef-a20e-d4772746c05b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:26.674368 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-f5c9e44f-010e-47ef-a20e-d4772746c05b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:26.683797 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f5c9e44f-010e-47ef-a20e-d4772746c05b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:26.684113 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f5c9e44f-010e-47ef-a20e-d4772746c05b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:26.684877 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f5c9e44f-010e-47ef-a20e-d4772746c05b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:26.685530 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f5c9e44f-010e-47ef-a20e-d4772746c05b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:26.763271 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-f5c9e44f-010e-47ef-a20e-d4772746c05b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:26.772821 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f5c9e44f-010e-47ef-a20e-d4772746c05b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f" status: 200 len: 1294 microversion: 2.1 time: 0.103995 May 16 17:45:26.773390 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 346/667] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:26 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:27.526533 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-cf4f8a9d-c027-477e-867d-40f475acc310 req-4af5c725-c864-4f3d-a866-a0186081ea46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b033cd6f-aebe-48ae-aefd-f505e6f16bbc", "name": "network-vif-deleted", "tag": "d9c5c334-51e8-4667-bc89-5b3cf71031cf"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:27.534793 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-cf4f8a9d-c027-477e-867d-40f475acc310 req-4af5c725-c864-4f3d-a866-a0186081ea46 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:27.535266 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-cf4f8a9d-c027-477e-867d-40f475acc310 req-4af5c725-c864-4f3d-a866-a0186081ea46 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:27.546262 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-cf4f8a9d-c027-477e-867d-40f475acc310 req-4af5c725-c864-4f3d-a866-a0186081ea46 service nova] Creating event network-vif-deleted:d9c5c334-51e8-4667-bc89-5b3cf71031cf for instance b033cd6f-aebe-48ae-aefd-f505e6f16bbc on hv-cinder-83769 May 16 17:45:27.550966 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-cf4f8a9d-c027-477e-867d-40f475acc310 req-4af5c725-c864-4f3d-a866-a0186081ea46 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162376 May 16 17:45:27.551552 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 322/668] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:45:27.637126 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0a84ff5d-4b5c-47bc-86f1-99a6e20377d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:27.637795 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-0a84ff5d-4b5c-47bc-86f1-99a6e20377d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:27.644130 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0a84ff5d-4b5c-47bc-86f1-99a6e20377d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:27.644726 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0a84ff5d-4b5c-47bc-86f1-99a6e20377d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:27.645516 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0a84ff5d-4b5c-47bc-86f1-99a6e20377d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:27.645973 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0a84ff5d-4b5c-47bc-86f1-99a6e20377d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:27.681612 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0a84ff5d-4b5c-47bc-86f1-99a6e20377d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:27.682282 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0a84ff5d-4b5c-47bc-86f1-99a6e20377d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:27.682793 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.objects.instance [None req-0a84ff5d-4b5c-47bc-86f1-99a6e20377d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lazy-loading 'fault' on Instance uuid b033cd6f-aebe-48ae-aefd-f505e6f16bbc {{(pid=128815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:45:27.728640 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-0a84ff5d-4b5c-47bc-86f1-99a6e20377d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c482d82afb734e10a5a11070fcb5f736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eddf9ae85b940b8bd556f4cf66c0b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:27.737787 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-0a84ff5d-4b5c-47bc-86f1-99a6e20377d8 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 200 len: 1311 microversion: 2.1 time: 0.105266 May 16 17:45:27.738917 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 347/669] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:27 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:27.800146 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-690908ab-5cf0-473f-b20d-018ee1ac44c7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:27.801001 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-690908ab-5cf0-473f-b20d-018ee1ac44c7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:27.808349 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-690908ab-5cf0-473f-b20d-018ee1ac44c7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:27.808793 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-690908ab-5cf0-473f-b20d-018ee1ac44c7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:27.809701 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-690908ab-5cf0-473f-b20d-018ee1ac44c7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:27.810309 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-690908ab-5cf0-473f-b20d-018ee1ac44c7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:27.909789 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-690908ab-5cf0-473f-b20d-018ee1ac44c7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:27.919001 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-690908ab-5cf0-473f-b20d-018ee1ac44c7 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f" status: 200 len: 1300 microversion: 2.1 time: 0.132307 May 16 17:45:27.920193 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 323/670] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:27 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f => generated 1300 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:28.757839 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0f379407-c652-4a36-bc8a-198916ad5759 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:28.758889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-0f379407-c652-4a36-bc8a-198916ad5759 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] [instance: b033cd6f-aebe-48ae-aefd-f505e6f16bbc] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:28.773994 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0f379407-c652-4a36-bc8a-198916ad5759 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:28.774660 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0f379407-c652-4a36-bc8a-198916ad5759 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:28.775654 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0f379407-c652-4a36-bc8a-198916ad5759 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:28.776089 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0f379407-c652-4a36-bc8a-198916ad5759 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:28.792561 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-0f379407-c652-4a36-bc8a-198916ad5759 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] HTTP exception thrown: Instance b033cd6f-aebe-48ae-aefd-f505e6f16bbc could not be found. May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0f379407-c652-4a36-bc8a-198916ad5759 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Request method failure captured: May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc HTTP/1.1 May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigox3Qmb4992kn72mY0kZabi3WWaMoKtsNJ81h1vGTu6lqq_JffhZxwNoadReBgNHMCVOBH4NrH9XXgD7nYDL--nkddztfIg0jyy7tVCW5L3LondFz79JY-50aJZtbJok48vYOP6Nqc0oTFz5yi_gn8jJF0uyZpp_zS0drwvaV5rtuvk May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 1eddf9ae85b940b8bd556f4cf66c0b79 May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1737598232 May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:45:28.794118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:45:28.795924 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eddf9ae85b940b8bd556f4cf66c0b79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1eddf9ae85b940b8bd556f4cf66c0b79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1eddf9ae85b940b8bd556f4cf66c0b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eddf9ae85b940b8bd556f4cf66c0b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:45:28.795924 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1737598232 May 16 17:45:28.795924 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 1eddf9ae85b940b8bd556f4cf66c0b79 May 16 17:45:28.795924 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1737598232 May 16 17:45:28.795924 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-ServerRescueNegativeTestJSON-1737598232-project May 16 17:45:28.795924 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:45:28.795924 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:45:28.795924 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: c482d82afb734e10a5a11070fcb5f736 May 16 17:45:28.795924 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1737598232-project May 16 17:45:28.795924 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:45:28.795924 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance b033cd6f-aebe-48ae-aefd-f505e6f16bbc could not be found. May 16 17:45:28.795924 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': 'b033cd6f-aebe-48ae-aefd-f505e6f16bbc'} May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b033cd6f-aebe-48ae-aefd-f505e6f16bbc could not be found. May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:45:28.796637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:45:28.798033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:45:28.798033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:45:28.798033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:45:28.798033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:45:28.798033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:45:28.798033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:45:28.798033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:45:28.798033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b033cd6f-aebe-48ae-aefd-f505e6f16bbc could not be found. May 16 17:45:28.798033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:28.798033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:45:28.798033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:28.798033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:28.798033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:45:28.798033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:45:28.798033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:45:28.798033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:45:28.798033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b033cd6f-aebe-48ae-aefd-f505e6f16bbc could not be found. May 16 17:45:28.798033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:45:28.799319 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0f379407-c652-4a36-bc8a-198916ad5759 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] Returning 404 to user: Instance b033cd6f-aebe-48ae-aefd-f505e6f16bbc could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:45:28.799319 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-0f379407-c652-4a36-bc8a-198916ad5759 tempest-ServerRescueNegativeTestJSON-1737598232 tempest-ServerRescueNegativeTestJSON-1737598232-project] 10.222.0.58 "GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc" status: 404 len: 111 microversion: 2.1 time: 0.043865 May 16 17:45:28.799319 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 348/671] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:28 2022] GET /compute/v2.1/servers/b033cd6f-aebe-48ae-aefd-f505e6f16bbc => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:45:28.924321 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-a310ebb2-1f80-4fc8-8b1f-35b84f75c490 req-9baf5949-773d-4036-b7c1-47b4ee954aba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48d4742-7c3e-4568-8424-d73ce0bf371f", "tag": "3b12e281-cf95-4d90-8772-1151abc09698"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:28.941637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d6e428fe-d5cb-4d9f-b0bd-51054facdae5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:28.945207 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d6e428fe-d5cb-4d9f-b0bd-51054facdae5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:28.959686 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-a310ebb2-1f80-4fc8-8b1f-35b84f75c490 req-9baf5949-773d-4036-b7c1-47b4ee954aba service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:28.961125 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d6e428fe-d5cb-4d9f-b0bd-51054facdae5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:28.961754 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-a310ebb2-1f80-4fc8-8b1f-35b84f75c490 req-9baf5949-773d-4036-b7c1-47b4ee954aba service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:28.962075 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d6e428fe-d5cb-4d9f-b0bd-51054facdae5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:28.965650 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d6e428fe-d5cb-4d9f-b0bd-51054facdae5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:28.966477 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d6e428fe-d5cb-4d9f-b0bd-51054facdae5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:28.993465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-a310ebb2-1f80-4fc8-8b1f-35b84f75c490 req-9baf5949-773d-4036-b7c1-47b4ee954aba service nova] Creating event network-changed:3b12e281-cf95-4d90-8772-1151abc09698 for instance a48d4742-7c3e-4568-8424-d73ce0bf371f on hv-cinder-83769 May 16 17:45:29.001811 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-a310ebb2-1f80-4fc8-8b1f-35b84f75c490 req-9baf5949-773d-4036-b7c1-47b4ee954aba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082819 May 16 17:45:29.003280 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 324/672] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:45:29.227071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d6e428fe-d5cb-4d9f-b0bd-51054facdae5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:29.235172 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d6e428fe-d5cb-4d9f-b0bd-51054facdae5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f" status: 200 len: 1366 microversion: 2.1 time: 0.301234 May 16 17:45:29.236216 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 349/673] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:28 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:30.253663 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-aa23eb6b-6c9a-4152-a704-2c3611287f4d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:30.255674 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-aa23eb6b-6c9a-4152-a704-2c3611287f4d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:30.264558 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-aa23eb6b-6c9a-4152-a704-2c3611287f4d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:30.265155 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-aa23eb6b-6c9a-4152-a704-2c3611287f4d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:30.265990 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-aa23eb6b-6c9a-4152-a704-2c3611287f4d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:30.266426 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-aa23eb6b-6c9a-4152-a704-2c3611287f4d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:30.523312 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-aa23eb6b-6c9a-4152-a704-2c3611287f4d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:30.533521 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-aa23eb6b-6c9a-4152-a704-2c3611287f4d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f" status: 200 len: 1366 microversion: 2.1 time: 0.284628 May 16 17:45:30.543090 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 325/674] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:30 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:31.552728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ff4c0607-7c98-40fe-96de-ca9e33eaa353 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:31.553953 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ff4c0607-7c98-40fe-96de-ca9e33eaa353 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:31.560535 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ff4c0607-7c98-40fe-96de-ca9e33eaa353 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:31.560982 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ff4c0607-7c98-40fe-96de-ca9e33eaa353 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:31.561784 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ff4c0607-7c98-40fe-96de-ca9e33eaa353 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:31.562214 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ff4c0607-7c98-40fe-96de-ca9e33eaa353 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:32.035433 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ff4c0607-7c98-40fe-96de-ca9e33eaa353 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:32.043962 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ff4c0607-7c98-40fe-96de-ca9e33eaa353 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f" status: 200 len: 1366 microversion: 2.1 time: 0.496445 May 16 17:45:32.044510 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 350/675] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:31 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f => generated 1366 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:33.061775 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-151ae7d1-85cd-44bc-9c17-281640ee6584 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:33.062395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-151ae7d1-85cd-44bc-9c17-281640ee6584 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:33.069103 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-151ae7d1-85cd-44bc-9c17-281640ee6584 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:33.069593 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-151ae7d1-85cd-44bc-9c17-281640ee6584 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:33.070381 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-151ae7d1-85cd-44bc-9c17-281640ee6584 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:33.070821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-151ae7d1-85cd-44bc-9c17-281640ee6584 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:33.203484 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-151ae7d1-85cd-44bc-9c17-281640ee6584 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:33.211140 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-151ae7d1-85cd-44bc-9c17-281640ee6584 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f" status: 200 len: 1366 microversion: 2.1 time: 0.153693 May 16 17:45:33.211718 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 326/676] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:33 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:33.709474 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-e508912a-062d-48b4-a7ff-536130d1d1fd req-f2f7e4c9-1ca8-43b8-95c4-24a70ce439d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48d4742-7c3e-4568-8424-d73ce0bf371f", "name": "network-vif-plugged", "status": "completed", "tag": "3b12e281-cf95-4d90-8772-1151abc09698"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:33.718125 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-e508912a-062d-48b4-a7ff-536130d1d1fd req-f2f7e4c9-1ca8-43b8-95c4-24a70ce439d7 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:33.718567 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-e508912a-062d-48b4-a7ff-536130d1d1fd req-f2f7e4c9-1ca8-43b8-95c4-24a70ce439d7 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:33.729673 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-e508912a-062d-48b4-a7ff-536130d1d1fd req-f2f7e4c9-1ca8-43b8-95c4-24a70ce439d7 service nova] Creating event network-vif-plugged:3b12e281-cf95-4d90-8772-1151abc09698 for instance a48d4742-7c3e-4568-8424-d73ce0bf371f on hv-cinder-83769 May 16 17:45:33.734758 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-e508912a-062d-48b4-a7ff-536130d1d1fd req-f2f7e4c9-1ca8-43b8-95c4-24a70ce439d7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150760 May 16 17:45:33.735360 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 351/677] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:45:34.229146 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-5f392519-fc92-426c-b0df-acd4af2caa5d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:34.229830 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-5f392519-fc92-426c-b0df-acd4af2caa5d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:34.236568 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5f392519-fc92-426c-b0df-acd4af2caa5d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:34.237015 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5f392519-fc92-426c-b0df-acd4af2caa5d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:34.237819 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5f392519-fc92-426c-b0df-acd4af2caa5d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:34.238391 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5f392519-fc92-426c-b0df-acd4af2caa5d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:34.387660 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-5f392519-fc92-426c-b0df-acd4af2caa5d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:34.395444 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-5f392519-fc92-426c-b0df-acd4af2caa5d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f" status: 200 len: 1366 microversion: 2.1 time: 0.170871 May 16 17:45:34.396017 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 327/678] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:34 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:35.413589 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-27a1cc87-2be4-47bd-aeda-f8649a0c7372 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:35.414293 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-27a1cc87-2be4-47bd-aeda-f8649a0c7372 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:35.421570 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-27a1cc87-2be4-47bd-aeda-f8649a0c7372 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:35.423546 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-27a1cc87-2be4-47bd-aeda-f8649a0c7372 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:35.424340 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-27a1cc87-2be4-47bd-aeda-f8649a0c7372 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:35.424776 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-27a1cc87-2be4-47bd-aeda-f8649a0c7372 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:35.598506 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-27a1cc87-2be4-47bd-aeda-f8649a0c7372 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:35.607475 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-27a1cc87-2be4-47bd-aeda-f8649a0c7372 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f" status: 200 len: 1366 microversion: 2.1 time: 0.198642 May 16 17:45:35.619644 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 352/679] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:35 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:36.628724 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-258ffcdc-6a54-4d06-8c4e-2977df1b69c5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:36.629614 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-258ffcdc-6a54-4d06-8c4e-2977df1b69c5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:36.638838 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-258ffcdc-6a54-4d06-8c4e-2977df1b69c5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:36.639701 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-258ffcdc-6a54-4d06-8c4e-2977df1b69c5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:36.640722 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-258ffcdc-6a54-4d06-8c4e-2977df1b69c5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:36.641568 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-258ffcdc-6a54-4d06-8c4e-2977df1b69c5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:36.802657 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-258ffcdc-6a54-4d06-8c4e-2977df1b69c5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:36.811574 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-258ffcdc-6a54-4d06-8c4e-2977df1b69c5 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f" status: 200 len: 1555 microversion: 2.1 time: 0.188113 May 16 17:45:36.813006 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 328/680] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:36 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f => generated 1555 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:36.829222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-162356f4-d689-4106-bd1e-214d8388391b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:36.829774 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-162356f4-d689-4106-bd1e-214d8388391b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:36.841978 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-162356f4-d689-4106-bd1e-214d8388391b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:36.842892 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-162356f4-d689-4106-bd1e-214d8388391b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:36.844417 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-162356f4-d689-4106-bd1e-214d8388391b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:36.845039 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-162356f4-d689-4106-bd1e-214d8388391b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:36.949760 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-162356f4-d689-4106-bd1e-214d8388391b tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123941 May 16 17:45:36.950582 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 353/681] 10.222.0.58 () {58 vars in 1274 bytes} [Mon May 16 17:45:36 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:45:37.197952 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-566e345d-2648-4877-b367-175d2d69eab6 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2146891402"}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:37.198493 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-566e345d-2648-4877-b367-175d2d69eab6 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:37.210102 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-566e345d-2648-4877-b367-175d2d69eab6 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:37.210710 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-566e345d-2648-4877-b367-175d2d69eab6 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:37.211630 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-566e345d-2648-4877-b367-175d2d69eab6 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:37.212127 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-566e345d-2648-4877-b367-175d2d69eab6 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:37.553574 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.network.security_group_api [None req-566e345d-2648-4877-b367-175d2d69eab6 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Removing security group 1b88c01b-7f15-4181-b815-3a895a7d0309 from port aa1eb09f-24cd-4a34-b6e7-2d41f1534a63 May 16 17:45:37.907940 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-c5282044-fbca-4db8-a5c5-d0a788ec12ab tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Action: 'create', calling method: .version_select at 0x7f79a48b2f70>, body: {"keypair": {"name": "tempest-keypair-984443825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZVO8ZdhFblrNPBHLWbBA4X4f7sI+ooyG35cPvDrjorNbrXfRTcLIOSVf5oyGIWpdaYKS3j0QmvbJy4SGC36OHc7xhiE4AMrxuijLHi7IXSYcdaMNjdsP5TEXbl9VSgUQ=="}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:37.925932 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-c5282044-fbca-4db8-a5c5-d0a788ec12ab tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Getting quotas for project 8b218f6b53844d828be7b8c5de1cde67. Resources: {'key_pairs'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:45:37.930060 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-c5282044-fbca-4db8-a5c5-d0a788ec12ab tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Getting quotas for user e1ddee42951b4de98dea071f2b7a9958 and project 8b218f6b53844d828be7b8c5de1cde67. Resources: {'key_pairs'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:45:37.960774 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-c5282044-fbca-4db8-a5c5-d0a788ec12ab tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.107041 May 16 17:45:37.961433 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 354/682] 10.222.0.58 () {62 vars in 1199 bytes} [Mon May 16 17:45:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 16 17:45:38.395849 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-566e345d-2648-4877-b367-175d2d69eab6 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "POST /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9/action" status: 202 len: 0 microversion: 2.1 time: 1.202268 May 16 17:45:38.397442 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 329/683] 10.222.0.58 () {60 vars in 1277 bytes} [Mon May 16 17:45:37 2022] POST /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9/action => generated 0 bytes in 1205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:45:38.422854 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-6a6b4218-6939-43e7-8fa7-47a6a46a2b31 req-69a69b6c-3ac3-4b61-824b-29de9870e6cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1928d55-33be-43a7-9d30-fcee59478af9", "tag": "aa1eb09f-24cd-4a34-b6e7-2d41f1534a63"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:38.447035 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-6a6b4218-6939-43e7-8fa7-47a6a46a2b31 req-69a69b6c-3ac3-4b61-824b-29de9870e6cf service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:38.448141 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-6a6b4218-6939-43e7-8fa7-47a6a46a2b31 req-69a69b6c-3ac3-4b61-824b-29de9870e6cf service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:38.469254 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-6a6b4218-6939-43e7-8fa7-47a6a46a2b31 req-69a69b6c-3ac3-4b61-824b-29de9870e6cf service nova] Creating event network-changed:aa1eb09f-24cd-4a34-b6e7-2d41f1534a63 for instance e1928d55-33be-43a7-9d30-fcee59478af9 on hv-cinder-83769 May 16 17:45:38.478091 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-6a6b4218-6939-43e7-8fa7-47a6a46a2b31 req-69a69b6c-3ac3-4b61-824b-29de9870e6cf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059556 May 16 17:45:38.478885 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 355/684] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:45:40.525264 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-312c6e07-a3c5-4afb-af7a-3c4643e508d1 req-ce8696cb-ef3a-4bf1-8169-9a55529ced4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48d4742-7c3e-4568-8424-d73ce0bf371f", "tag": "3b12e281-cf95-4d90-8772-1151abc09698"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:40.534935 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-312c6e07-a3c5-4afb-af7a-3c4643e508d1 req-ce8696cb-ef3a-4bf1-8169-9a55529ced4e service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:40.535676 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-312c6e07-a3c5-4afb-af7a-3c4643e508d1 req-ce8696cb-ef3a-4bf1-8169-9a55529ced4e service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:40.547919 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-312c6e07-a3c5-4afb-af7a-3c4643e508d1 req-ce8696cb-ef3a-4bf1-8169-9a55529ced4e service nova] Creating event network-changed:3b12e281-cf95-4d90-8772-1151abc09698 for instance a48d4742-7c3e-4568-8424-d73ce0bf371f on hv-cinder-83769 May 16 17:45:40.553909 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-312c6e07-a3c5-4afb-af7a-3c4643e508d1 req-ce8696cb-ef3a-4bf1-8169-9a55529ced4e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032534 May 16 17:45:40.554720 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 330/685] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:45:40.588676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-92a64739-e89a-4322-b968-5624b18c3596 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:40.589264 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-92a64739-e89a-4322-b968-5624b18c3596 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:40.597034 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-92a64739-e89a-4322-b968-5624b18c3596 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:40.597826 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-92a64739-e89a-4322-b968-5624b18c3596 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:40.599472 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-92a64739-e89a-4322-b968-5624b18c3596 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:40.601309 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-92a64739-e89a-4322-b968-5624b18c3596 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:40.728895 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.objects.instance [None req-92a64739-e89a-4322-b968-5624b18c3596 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lazy-loading 'services' on Instance uuid e1928d55-33be-43a7-9d30-fcee59478af9 {{(pid=128815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:45:40.885742 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-92a64739-e89a-4322-b968-5624b18c3596 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9/os-volume_attachments/202cb216-d561-4fc3-ad87-eb758daba63a" status: 202 len: 0 microversion: 2.1 time: 0.304136 May 16 17:45:40.886357 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 356/686] 10.222.0.58 () {58 vars in 1415 bytes} [Mon May 16 17:45:40 2022] DELETE /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9/os-volume_attachments/202cb216-d561-4fc3-ad87-eb758daba63a => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:45:40.908886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-23737e32-8755-4d51-bfdd-8df2c7c52f5d tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:40.912416 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-23737e32-8755-4d51-bfdd-8df2c7c52f5d tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:40.942945 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-23737e32-8755-4d51-bfdd-8df2c7c52f5d tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:40.945540 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-23737e32-8755-4d51-bfdd-8df2c7c52f5d tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:40.947044 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-23737e32-8755-4d51-bfdd-8df2c7c52f5d tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:40.947044 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-23737e32-8755-4d51-bfdd-8df2c7c52f5d tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:41.041000 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-23737e32-8755-4d51-bfdd-8df2c7c52f5d tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149414 May 16 17:45:41.043565 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-9c375cc0-5dce-4d7f-ba0b-e7323c7707f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1534620547", "imageRef": "782bd628-ef1b-419c-99f5-2c312d1766a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0229cc9-7da5-499c-a6ca-89f02d2e0332"}], "security_groups": [{"name": "tempest-securitygroup--793408338"}], "key_name": "tempest-keypair-984443825", "user_data": "}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:41.046542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 331/687] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:45:40 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:45:41.215421 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.network.neutron [None req-9c375cc0-5dce-4d7f-ba0b-e7323c7707f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] validate_networks() for [('e0229cc9-7da5-499c-a6ca-89f02d2e0332', None, None, None, None, None)] {{(pid=128815) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:45:41.798274 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-9c375cc0-5dce-4d7f-ba0b-e7323c7707f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Flavor limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:45:41.798905 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-9c375cc0-5dce-4d7f-ba0b-e7323c7707f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Image limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:45:41.799148 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-9c375cc0-5dce-4d7f-ba0b-e7323c7707f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Flavor pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:45:41.799732 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-9c375cc0-5dce-4d7f-ba0b-e7323c7707f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Image pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:45:41.800171 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-9c375cc0-5dce-4d7f-ba0b-e7323c7707f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:45:41.811264 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9c375cc0-5dce-4d7f-ba0b-e7323c7707f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:41.812003 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9c375cc0-5dce-4d7f-ba0b-e7323c7707f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:41.812964 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9c375cc0-5dce-4d7f-ba0b-e7323c7707f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:41.813539 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9c375cc0-5dce-4d7f-ba0b-e7323c7707f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:41.837619 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-9c375cc0-5dce-4d7f-ba0b-e7323c7707f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Getting quotas for project 8b218f6b53844d828be7b8c5de1cde67. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:45:41.841578 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-9c375cc0-5dce-4d7f-ba0b-e7323c7707f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Getting quotas for user e1ddee42951b4de98dea071f2b7a9958 and project 8b218f6b53844d828be7b8c5de1cde67. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:45:41.853857 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-9c375cc0-5dce-4d7f-ba0b-e7323c7707f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Going to run 1 instances... {{(pid=128815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:45:41.856420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-9c375cc0-5dce-4d7f-ba0b-e7323c7707f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='782bd628-ef1b-419c-99f5-2c312d1766a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:45:41.903513 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-9c375cc0-5dce-4d7f-ba0b-e7323c7707f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.865001 May 16 17:45:41.908962 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 357/688] 10.222.0.58 () {62 vars in 1187 bytes} [Mon May 16 17:45:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 16 17:45:41.915025 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9629646c-0a52-492f-b5d9-3713e9d3d3fe tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:41.916005 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-9629646c-0a52-492f-b5d9-3713e9d3d3fe tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:41.974199 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9629646c-0a52-492f-b5d9-3713e9d3d3fe tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:41.982443 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9629646c-0a52-492f-b5d9-3713e9d3d3fe tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:41.984204 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9629646c-0a52-492f-b5d9-3713e9d3d3fe tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:41.985394 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-9629646c-0a52-492f-b5d9-3713e9d3d3fe tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1281 microversion: 2.20 time: 0.074673 May 16 17:45:41.991416 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 332/689] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:45:41 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1281 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:45:42.057936 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-b34be055-ea42-4d92-926a-9d0048758fe3 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:42.059405 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b34be055-ea42-4d92-926a-9d0048758fe3 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:42.066933 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b34be055-ea42-4d92-926a-9d0048758fe3 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:42.067458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b34be055-ea42-4d92-926a-9d0048758fe3 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:42.068493 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b34be055-ea42-4d92-926a-9d0048758fe3 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:42.069133 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b34be055-ea42-4d92-926a-9d0048758fe3 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:42.100637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-b34be055-ea42-4d92-926a-9d0048758fe3 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046947 May 16 17:45:42.101227 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 358/690] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:45:42 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 17:45:42.111067 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-81515d18-c3d5-45b3-860e-2c4b3555406d tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:42.111846 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-81515d18-c3d5-45b3-860e-2c4b3555406d tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:42.119397 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-81515d18-c3d5-45b3-860e-2c4b3555406d tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:42.119879 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-81515d18-c3d5-45b3-860e-2c4b3555406d tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:42.120616 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-81515d18-c3d5-45b3-860e-2c4b3555406d tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:42.121093 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-81515d18-c3d5-45b3-860e-2c4b3555406d tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:42.215670 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-81515d18-c3d5-45b3-860e-2c4b3555406d tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] HTTP exception thrown: Instance e1928d55-33be-43a7-9d30-fcee59478af9 is not attached to volume 202cb216-d561-4fc3-ad87-eb758daba63a May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-81515d18-c3d5-45b3-860e-2c4b3555406d tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Request method failure captured: May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: DELETE /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9/os-volume_attachments/202cb216-d561-4fc3-ad87-eb758daba63a HTTP/1.1 May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigo0ojLJ3czKXTRbV0Q3PMafnXxpI-2n0KRneMJxaU-MDet0MJX24jKG3YmYj1-lc4wncMB0uMDOI879rE8L0Iba36l2t8ePDLVzD3aR_5B4YTU5jrq06PcVmQga0AKgauFM4xtU2lZuT63IUhS5_8cONazt-ZLuiyMcClAenfGr_6FU May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 2a1f3dc604cd46e4961489cd14f66d13 May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-TestMinimumBasicScenario-354628067 May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:45:42.218178 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:45:42.219597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a1f3dc604cd46e4961489cd14f66d13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a1f3dc604cd46e4961489cd14f66d13", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a1f3dc604cd46e4961489cd14f66d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a1f3dc604cd46e4961489cd14f66d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:45:42.219597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-TestMinimumBasicScenario-354628067 May 16 17:45:42.219597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 2a1f3dc604cd46e4961489cd14f66d13 May 16 17:45:42.219597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-TestMinimumBasicScenario-354628067 May 16 17:45:42.219597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-TestMinimumBasicScenario-354628067-project May 16 17:45:42.219597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:45:42.219597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:45:42.219597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: fea27ed178c8437697a23591a2163768 May 16 17:45:42.219597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-TestMinimumBasicScenario-354628067-project May 16 17:45:42.219597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:45:42.219597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance e1928d55-33be-43a7-9d30-fcee59478af9 is not attached to volume 202cb216-d561-4fc3-ad87-eb758daba63a May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'server_id': 'e1928d55-33be-43a7-9d30-fcee59478af9', 'id': '202cb216-d561-4fc3-ad87-eb758daba63a'} May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 202cb216-d561-4fc3-ad87-eb758daba63a. May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:45:42.220320 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:45:42.221434 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:45:42.221434 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 16 17:45:42.221434 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 16 17:45:42.221434 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1928d55-33be-43a7-9d30-fcee59478af9 is not attached to volume 202cb216-d561-4fc3-ad87-eb758daba63a May 16 17:45:42.221434 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:45:42.221434 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:45:42.221434 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:45:42.221434 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:42.221434 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:45:42.221434 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:45:42.221434 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:45:42.221434 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:45:42.221434 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1928d55-33be-43a7-9d30-fcee59478af9 is not attached to volume 202cb216-d561-4fc3-ad87-eb758daba63a May 16 17:45:42.221434 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:45:42.221434 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-81515d18-c3d5-45b3-860e-2c4b3555406d tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Returning 404 to user: Instance e1928d55-33be-43a7-9d30-fcee59478af9 is not attached to volume 202cb216-d561-4fc3-ad87-eb758daba63a {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:45:42.222456 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-81515d18-c3d5-45b3-860e-2c4b3555406d tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9/os-volume_attachments/202cb216-d561-4fc3-ad87-eb758daba63a" status: 404 len: 154 microversion: 2.1 time: 0.112662 May 16 17:45:42.224277 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 333/691] 10.222.0.58 () {58 vars in 1415 bytes} [Mon May 16 17:45:42 2022] DELETE /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9/os-volume_attachments/202cb216-d561-4fc3-ad87-eb758daba63a => generated 154 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:45:42.585519 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-3c85d82f-338f-4b55-994b-7b59844ca6d4 req-15947fb1-017d-4135-810f-0b758b3c412d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1928d55-33be-43a7-9d30-fcee59478af9", "tag": "aa1eb09f-24cd-4a34-b6e7-2d41f1534a63"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:42.594190 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-3c85d82f-338f-4b55-994b-7b59844ca6d4 req-15947fb1-017d-4135-810f-0b758b3c412d service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:42.594664 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-3c85d82f-338f-4b55-994b-7b59844ca6d4 req-15947fb1-017d-4135-810f-0b758b3c412d service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:42.605931 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-3c85d82f-338f-4b55-994b-7b59844ca6d4 req-15947fb1-017d-4135-810f-0b758b3c412d service nova] Creating event network-changed:aa1eb09f-24cd-4a34-b6e7-2d41f1534a63 for instance e1928d55-33be-43a7-9d30-fcee59478af9 on hv-cinder-83769 May 16 17:45:42.610602 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-3c85d82f-338f-4b55-994b-7b59844ca6d4 req-15947fb1-017d-4135-810f-0b758b3c412d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031787 May 16 17:45:42.611190 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 359/692] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:45:43.004291 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-dcf2a83e-5459-46ae-ab23-9dba4b10cc2d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:43.005917 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-dcf2a83e-5459-46ae-ab23-9dba4b10cc2d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:43.013979 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-dcf2a83e-5459-46ae-ab23-9dba4b10cc2d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:43.014644 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-dcf2a83e-5459-46ae-ab23-9dba4b10cc2d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:43.016111 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-dcf2a83e-5459-46ae-ab23-9dba4b10cc2d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:43.016630 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-dcf2a83e-5459-46ae-ab23-9dba4b10cc2d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:43.125145 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-dcf2a83e-5459-46ae-ab23-9dba4b10cc2d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:43.134466 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-dcf2a83e-5459-46ae-ab23-9dba4b10cc2d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:43.135989 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-dcf2a83e-5459-46ae-ab23-9dba4b10cc2d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:43.137267 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-dcf2a83e-5459-46ae-ab23-9dba4b10cc2d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1341 microversion: 2.20 time: 0.137129 May 16 17:45:43.137992 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 334/693] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:45:42 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1341 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:45:43.401383 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-eba3fd52-a43f-4bf3-b13b-83be565e147a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:43.401987 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-eba3fd52-a43f-4bf3-b13b-83be565e147a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:43.409176 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-eba3fd52-a43f-4bf3-b13b-83be565e147a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:43.409655 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-eba3fd52-a43f-4bf3-b13b-83be565e147a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:43.410445 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-eba3fd52-a43f-4bf3-b13b-83be565e147a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:43.410933 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-eba3fd52-a43f-4bf3-b13b-83be565e147a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:43.443053 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-eba3fd52-a43f-4bf3-b13b-83be565e147a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Going to try to terminate instance {{(pid=128815) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:45:43.520806 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-eba3fd52-a43f-4bf3-b13b-83be565e147a tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 204 len: 0 microversion: 2.1 time: 0.123123 May 16 17:45:43.521966 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 360/694] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:45:43 2022] DELETE /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 17:45:43.530756 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e03813d3-06ac-422f-9741-d94c695d0b4c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:43.531471 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e03813d3-06ac-422f-9741-d94c695d0b4c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:43.537674 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e03813d3-06ac-422f-9741-d94c695d0b4c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:43.538196 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e03813d3-06ac-422f-9741-d94c695d0b4c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:43.539073 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e03813d3-06ac-422f-9741-d94c695d0b4c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:43.539608 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e03813d3-06ac-422f-9741-d94c695d0b4c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:43.737673 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e03813d3-06ac-422f-9741-d94c695d0b4c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:43.745446 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e03813d3-06ac-422f-9741-d94c695d0b4c tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1553 microversion: 2.1 time: 0.218757 May 16 17:45:43.746065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 335/695] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:43 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1553 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:45:44.160243 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ed4175d8-285c-4aa5-afbd-6d7395cd7699 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:44.161225 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ed4175d8-285c-4aa5-afbd-6d7395cd7699 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:44.171407 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ed4175d8-285c-4aa5-afbd-6d7395cd7699 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:44.172036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ed4175d8-285c-4aa5-afbd-6d7395cd7699 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:44.173048 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ed4175d8-285c-4aa5-afbd-6d7395cd7699 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:44.173667 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ed4175d8-285c-4aa5-afbd-6d7395cd7699 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:44.312231 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ed4175d8-285c-4aa5-afbd-6d7395cd7699 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:44.324801 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ed4175d8-285c-4aa5-afbd-6d7395cd7699 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:44.327212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ed4175d8-285c-4aa5-afbd-6d7395cd7699 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:44.328868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ed4175d8-285c-4aa5-afbd-6d7395cd7699 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1406 microversion: 2.20 time: 0.176108 May 16 17:45:44.329703 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 361/696] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:45:44 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:45:44.763757 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-1bb179a8-5d34-489a-8996-8ca714c6c949 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:44.764366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-1bb179a8-5d34-489a-8996-8ca714c6c949 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:44.771337 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1bb179a8-5d34-489a-8996-8ca714c6c949 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:44.771785 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1bb179a8-5d34-489a-8996-8ca714c6c949 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:44.772551 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1bb179a8-5d34-489a-8996-8ca714c6c949 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:44.772985 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1bb179a8-5d34-489a-8996-8ca714c6c949 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:44.905992 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-1bb179a8-5d34-489a-8996-8ca714c6c949 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:44.913484 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-1bb179a8-5d34-489a-8996-8ca714c6c949 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1553 microversion: 2.1 time: 0.153754 May 16 17:45:44.914083 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 336/697] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:44 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:45.348567 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-49d7deed-e494-40af-8d88-e3c7c043c4ca tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:45.349328 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-49d7deed-e494-40af-8d88-e3c7c043c4ca tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:45.355864 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-49d7deed-e494-40af-8d88-e3c7c043c4ca tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:45.356313 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-49d7deed-e494-40af-8d88-e3c7c043c4ca tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:45.357088 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-49d7deed-e494-40af-8d88-e3c7c043c4ca tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:45.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-49d7deed-e494-40af-8d88-e3c7c043c4ca tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:45.557825 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-49d7deed-e494-40af-8d88-e3c7c043c4ca tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:45.566871 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-49d7deed-e494-40af-8d88-e3c7c043c4ca tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:45.569327 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-49d7deed-e494-40af-8d88-e3c7c043c4ca tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:45.570794 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-49d7deed-e494-40af-8d88-e3c7c043c4ca tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1406 microversion: 2.20 time: 0.226405 May 16 17:45:45.581854 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 362/698] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:45:45 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:45:45.747119 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-91a69629-7962-4fc7-b9a4-82deec57cdad req-0c65d532-0d17-4d49-81e2-e7709e28bb41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc200e3-53ea-4163-8472-0a5e8c70f07e", "tag": "f96fabff-8023-4c54-9a2c-526c3f834248"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:45.758015 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-91a69629-7962-4fc7-b9a4-82deec57cdad req-0c65d532-0d17-4d49-81e2-e7709e28bb41 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:45.758446 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-91a69629-7962-4fc7-b9a4-82deec57cdad req-0c65d532-0d17-4d49-81e2-e7709e28bb41 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:45.781726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-91a69629-7962-4fc7-b9a4-82deec57cdad req-0c65d532-0d17-4d49-81e2-e7709e28bb41 service nova] Creating event network-changed:f96fabff-8023-4c54-9a2c-526c3f834248 for instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e on hv-cinder-83769 May 16 17:45:45.797487 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-91a69629-7962-4fc7-b9a4-82deec57cdad req-0c65d532-0d17-4d49-81e2-e7709e28bb41 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054040 May 16 17:45:45.800759 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 337/699] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:45:45.837683 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-b09b62a5-b565-4075-ad01-22092bd60728 req-69bda3c2-a799-4938-bd79-88b7f6debc69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1928d55-33be-43a7-9d30-fcee59478af9", "name": "network-vif-deleted", "tag": "aa1eb09f-24cd-4a34-b6e7-2d41f1534a63"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:45.846806 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-b09b62a5-b565-4075-ad01-22092bd60728 req-69bda3c2-a799-4938-bd79-88b7f6debc69 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:45.847249 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-b09b62a5-b565-4075-ad01-22092bd60728 req-69bda3c2-a799-4938-bd79-88b7f6debc69 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:45.859889 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-b09b62a5-b565-4075-ad01-22092bd60728 req-69bda3c2-a799-4938-bd79-88b7f6debc69 service nova] Creating event network-vif-deleted:aa1eb09f-24cd-4a34-b6e7-2d41f1534a63 for instance e1928d55-33be-43a7-9d30-fcee59478af9 on hv-cinder-83769 May 16 17:45:45.865078 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-b09b62a5-b565-4075-ad01-22092bd60728 req-69bda3c2-a799-4938-bd79-88b7f6debc69 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031304 May 16 17:45:45.866181 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 363/700] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:45:45.931908 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-004128f4-7fb5-494e-8b38-9add7bd07107 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:45.932675 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-004128f4-7fb5-494e-8b38-9add7bd07107 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:45.940786 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-004128f4-7fb5-494e-8b38-9add7bd07107 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:45.941644 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-004128f4-7fb5-494e-8b38-9add7bd07107 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:45.942818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-004128f4-7fb5-494e-8b38-9add7bd07107 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:45.943504 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-004128f4-7fb5-494e-8b38-9add7bd07107 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:45.983949 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-004128f4-7fb5-494e-8b38-9add7bd07107 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:45.984096 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-004128f4-7fb5-494e-8b38-9add7bd07107 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:45.984537 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-004128f4-7fb5-494e-8b38-9add7bd07107 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lazy-loading 'fault' on Instance uuid e1928d55-33be-43a7-9d30-fcee59478af9 {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:45:46.049684 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-004128f4-7fb5-494e-8b38-9add7bd07107 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fea27ed178c8437697a23591a2163768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1f3dc604cd46e4961489cd14f66d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:46.058211 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-004128f4-7fb5-494e-8b38-9add7bd07107 tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 200 len: 1347 microversion: 2.1 time: 0.130690 May 16 17:45:46.058807 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 338/701] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:45 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 1347 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:45:46.589710 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-420c84d7-9fd6-4f9d-9840-a98931e7f503 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:46.590379 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-420c84d7-9fd6-4f9d-9840-a98931e7f503 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:46.597491 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-420c84d7-9fd6-4f9d-9840-a98931e7f503 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:46.598268 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-420c84d7-9fd6-4f9d-9840-a98931e7f503 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:46.599565 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-420c84d7-9fd6-4f9d-9840-a98931e7f503 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:46.600038 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-420c84d7-9fd6-4f9d-9840-a98931e7f503 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:46.752996 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-420c84d7-9fd6-4f9d-9840-a98931e7f503 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:46.761081 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-420c84d7-9fd6-4f9d-9840-a98931e7f503 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:46.762619 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-420c84d7-9fd6-4f9d-9840-a98931e7f503 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:46.763713 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-420c84d7-9fd6-4f9d-9840-a98931e7f503 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1406 microversion: 2.20 time: 0.178905 May 16 17:45:46.764275 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 364/702] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:45:46 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:45:47.084915 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-2b7da53b-dc08-4381-b9cd-ad79baa5ea2f tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:47.085705 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-2b7da53b-dc08-4381-b9cd-ad79baa5ea2f tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] [instance: e1928d55-33be-43a7-9d30-fcee59478af9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:47.094159 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2b7da53b-dc08-4381-b9cd-ad79baa5ea2f tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:47.094725 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2b7da53b-dc08-4381-b9cd-ad79baa5ea2f tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:47.095663 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2b7da53b-dc08-4381-b9cd-ad79baa5ea2f tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:47.096222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2b7da53b-dc08-4381-b9cd-ad79baa5ea2f tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:47.113270 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-2b7da53b-dc08-4381-b9cd-ad79baa5ea2f tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] HTTP exception thrown: Instance e1928d55-33be-43a7-9d30-fcee59478af9 could not be found. May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-2b7da53b-dc08-4381-b9cd-ad79baa5ea2f tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Request method failure captured: May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 HTTP/1.1 May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigo0ojLJ3czKXTRbV0Q3PMafnXxpI-2n0KRneMJxaU-MDet0MJX24jKG3YmYj1-lc4wncMB0uMDOI879rE8L0Iba36l2t8ePDLVzD3aR_5B4YTU5jrq06PcVmQga0AKgauFM4xtU2lZuT63IUhS5_8cONazt-ZLuiyMcClAenfGr_6FU May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 2a1f3dc604cd46e4961489cd14f66d13 May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-TestMinimumBasicScenario-354628067 May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:45:47.115413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:45:47.117058 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a1f3dc604cd46e4961489cd14f66d13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2a1f3dc604cd46e4961489cd14f66d13", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2a1f3dc604cd46e4961489cd14f66d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2a1f3dc604cd46e4961489cd14f66d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:45:47.117058 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-TestMinimumBasicScenario-354628067 May 16 17:45:47.117058 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 2a1f3dc604cd46e4961489cd14f66d13 May 16 17:45:47.117058 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-TestMinimumBasicScenario-354628067 May 16 17:45:47.117058 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-TestMinimumBasicScenario-354628067-project May 16 17:45:47.117058 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:45:47.117058 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:45:47.117058 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: fea27ed178c8437697a23591a2163768 May 16 17:45:47.117058 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-TestMinimumBasicScenario-354628067-project May 16 17:45:47.117058 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:45:47.117058 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance e1928d55-33be-43a7-9d30-fcee59478af9 could not be found. May 16 17:45:47.117058 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': 'e1928d55-33be-43a7-9d30-fcee59478af9'} May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1928d55-33be-43a7-9d30-fcee59478af9 could not be found. May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:45:47.117991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:45:47.119384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:45:47.119384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:45:47.119384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:45:47.119384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:45:47.119384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:45:47.119384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:45:47.119384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:45:47.119384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1928d55-33be-43a7-9d30-fcee59478af9 could not be found. May 16 17:45:47.119384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:45:47.119384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:45:47.119384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:45:47.119384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:45:47.119384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:45:47.119384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:45:47.119384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:45:47.119384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:45:47.119384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1928d55-33be-43a7-9d30-fcee59478af9 could not be found. May 16 17:45:47.119384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:45:47.121154 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-2b7da53b-dc08-4381-b9cd-ad79baa5ea2f tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Returning 404 to user: Instance e1928d55-33be-43a7-9d30-fcee59478af9 could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:45:47.121154 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-2b7da53b-dc08-4381-b9cd-ad79baa5ea2f tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9" status: 404 len: 111 microversion: 2.1 time: 0.038278 May 16 17:45:47.121154 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 339/703] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:45:47 2022] GET /compute/v2.1/servers/e1928d55-33be-43a7-9d30-fcee59478af9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:45:47.125686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-22c6bdf3-3872-4ed2-87a2-59f7672119cf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] Calling method '.version_select at 0x7f79a4968ee0>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:47.146449 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-22c6bdf3-3872-4ed2-87a2-59f7672119cf tempest-TestMinimumBasicScenario-354628067 tempest-TestMinimumBasicScenario-354628067-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-70943443" status: 202 len: 0 microversion: 2.1 time: 0.024665 May 16 17:45:47.146999 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 365/704] 10.222.0.58 () {58 vars in 1265 bytes} [Mon May 16 17:45:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-70943443 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:45:47.781646 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-6c3aefe4-263a-4111-97b2-efd95bf64a92 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:47.782277 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-6c3aefe4-263a-4111-97b2-efd95bf64a92 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:47.788585 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6c3aefe4-263a-4111-97b2-efd95bf64a92 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:47.789043 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6c3aefe4-263a-4111-97b2-efd95bf64a92 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:47.789975 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6c3aefe4-263a-4111-97b2-efd95bf64a92 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:47.790629 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6c3aefe4-263a-4111-97b2-efd95bf64a92 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:47.995490 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-6c3aefe4-263a-4111-97b2-efd95bf64a92 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:48.004323 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-6c3aefe4-263a-4111-97b2-efd95bf64a92 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:48.006237 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-6c3aefe4-263a-4111-97b2-efd95bf64a92 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:48.007519 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-6c3aefe4-263a-4111-97b2-efd95bf64a92 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1406 microversion: 2.20 time: 0.229833 May 16 17:45:48.008233 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 340/705] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:45:47 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:45:49.026149 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0767545c-0f57-4053-9c76-fbb5b50e089c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:49.026714 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-0767545c-0f57-4053-9c76-fbb5b50e089c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:49.033093 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0767545c-0f57-4053-9c76-fbb5b50e089c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:49.033537 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0767545c-0f57-4053-9c76-fbb5b50e089c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:49.034321 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0767545c-0f57-4053-9c76-fbb5b50e089c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:49.034747 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0767545c-0f57-4053-9c76-fbb5b50e089c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:49.175340 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-0767545c-0f57-4053-9c76-fbb5b50e089c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:49.184057 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-0767545c-0f57-4053-9c76-fbb5b50e089c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:49.185564 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-0767545c-0f57-4053-9c76-fbb5b50e089c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:49.186686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-0767545c-0f57-4053-9c76-fbb5b50e089c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1406 microversion: 2.20 time: 0.165195 May 16 17:45:49.187233 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 366/706] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:45:49 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:45:50.210188 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-542b0b98-ac6f-4aa4-8772-30939f760fe0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:50.210804 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-542b0b98-ac6f-4aa4-8772-30939f760fe0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:50.217422 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-542b0b98-ac6f-4aa4-8772-30939f760fe0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:50.218115 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-542b0b98-ac6f-4aa4-8772-30939f760fe0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:50.218707 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-542b0b98-ac6f-4aa4-8772-30939f760fe0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:50.219147 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-542b0b98-ac6f-4aa4-8772-30939f760fe0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:50.419988 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-542b0b98-ac6f-4aa4-8772-30939f760fe0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:50.428526 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-542b0b98-ac6f-4aa4-8772-30939f760fe0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:50.430283 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-542b0b98-ac6f-4aa4-8772-30939f760fe0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:50.431571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-542b0b98-ac6f-4aa4-8772-30939f760fe0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1406 microversion: 2.20 time: 0.230912 May 16 17:45:50.432215 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 341/707] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:45:50 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:45:51.450539 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-82837ea4-3203-4e3b-bb02-ac1fbd29da95 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:51.451140 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-82837ea4-3203-4e3b-bb02-ac1fbd29da95 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:51.457435 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-82837ea4-3203-4e3b-bb02-ac1fbd29da95 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:51.457919 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-82837ea4-3203-4e3b-bb02-ac1fbd29da95 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:51.458773 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-82837ea4-3203-4e3b-bb02-ac1fbd29da95 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:51.459196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-82837ea4-3203-4e3b-bb02-ac1fbd29da95 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:51.599654 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-82837ea4-3203-4e3b-bb02-ac1fbd29da95 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:51.608079 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-82837ea4-3203-4e3b-bb02-ac1fbd29da95 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:51.610715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-82837ea4-3203-4e3b-bb02-ac1fbd29da95 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:51.611840 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-82837ea4-3203-4e3b-bb02-ac1fbd29da95 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1406 microversion: 2.20 time: 0.165533 May 16 17:45:51.612434 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 367/708] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:45:51 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:45:51.645940 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-769dd950-142c-45a5-a9fb-23e96b4d5a83 req-eeedc254-2e91-48d4-a56a-d6a96a424d1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc200e3-53ea-4163-8472-0a5e8c70f07e", "name": "network-vif-plugged", "status": "completed", "tag": "f96fabff-8023-4c54-9a2c-526c3f834248"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:51.655548 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-769dd950-142c-45a5-a9fb-23e96b4d5a83 req-eeedc254-2e91-48d4-a56a-d6a96a424d1c service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:51.656448 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-769dd950-142c-45a5-a9fb-23e96b4d5a83 req-eeedc254-2e91-48d4-a56a-d6a96a424d1c service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:51.669147 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-769dd950-142c-45a5-a9fb-23e96b4d5a83 req-eeedc254-2e91-48d4-a56a-d6a96a424d1c service nova] Creating event network-vif-plugged:f96fabff-8023-4c54-9a2c-526c3f834248 for instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e on hv-cinder-83769 May 16 17:45:51.674794 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-769dd950-142c-45a5-a9fb-23e96b4d5a83 req-eeedc254-2e91-48d4-a56a-d6a96a424d1c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032788 May 16 17:45:51.676256 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 342/709] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:45:52.631728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ee461942-8864-477f-a749-3768d6cf5e17 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:52.632336 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ee461942-8864-477f-a749-3768d6cf5e17 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:52.640148 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ee461942-8864-477f-a749-3768d6cf5e17 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:52.640592 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ee461942-8864-477f-a749-3768d6cf5e17 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:52.641486 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ee461942-8864-477f-a749-3768d6cf5e17 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:52.641948 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ee461942-8864-477f-a749-3768d6cf5e17 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:52.772765 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ee461942-8864-477f-a749-3768d6cf5e17 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:52.781108 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ee461942-8864-477f-a749-3768d6cf5e17 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:52.782612 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ee461942-8864-477f-a749-3768d6cf5e17 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:52.783705 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ee461942-8864-477f-a749-3768d6cf5e17 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1406 microversion: 2.20 time: 0.157650 May 16 17:45:52.784262 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 368/710] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:45:52 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:45:53.803106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c0f0158f-c630-45f4-90af-4ed88f57af13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:53.803798 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-c0f0158f-c630-45f4-90af-4ed88f57af13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:53.817468 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c0f0158f-c630-45f4-90af-4ed88f57af13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:53.819184 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c0f0158f-c630-45f4-90af-4ed88f57af13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:53.820428 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c0f0158f-c630-45f4-90af-4ed88f57af13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:53.821397 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c0f0158f-c630-45f4-90af-4ed88f57af13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:53.983727 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-c0f0158f-c630-45f4-90af-4ed88f57af13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:53.994237 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-c0f0158f-c630-45f4-90af-4ed88f57af13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:53.995930 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-c0f0158f-c630-45f4-90af-4ed88f57af13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:45:53.997283 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-c0f0158f-c630-45f4-90af-4ed88f57af13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1597 microversion: 2.20 time: 0.198992 May 16 17:45:53.999356 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 343/711] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:45:53 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1597 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:45:54.016050 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4f33d1d3-38fc-4aa5-8cb5-bee9e1523373 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:45:54.017220 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-4f33d1d3-38fc-4aa5-8cb5-bee9e1523373 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:45:54.024074 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4f33d1d3-38fc-4aa5-8cb5-bee9e1523373 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:54.024688 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4f33d1d3-38fc-4aa5-8cb5-bee9e1523373 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:54.025646 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4f33d1d3-38fc-4aa5-8cb5-bee9e1523373 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:54.026224 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4f33d1d3-38fc-4aa5-8cb5-bee9e1523373 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:54.115051 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-4f33d1d3-38fc-4aa5-8cb5-bee9e1523373 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103522 May 16 17:45:54.115781 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 369/712] 10.222.0.58 () {60 vars in 1315 bytes} [Mon May 16 17:45:54 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:45:55.331394 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-2e03c907-2647-4652-b377-b25091a3f48b req-0ecd5281-cece-4664-ada7-e07046a5cf46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc200e3-53ea-4163-8472-0a5e8c70f07e", "tag": "f96fabff-8023-4c54-9a2c-526c3f834248"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:45:55.342354 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-2e03c907-2647-4652-b377-b25091a3f48b req-0ecd5281-cece-4664-ada7-e07046a5cf46 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:45:55.342827 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-2e03c907-2647-4652-b377-b25091a3f48b req-0ecd5281-cece-4664-ada7-e07046a5cf46 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:45:55.356415 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-2e03c907-2647-4652-b377-b25091a3f48b req-0ecd5281-cece-4664-ada7-e07046a5cf46 service nova] Creating event network-changed:f96fabff-8023-4c54-9a2c-526c3f834248 for instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e on hv-cinder-83769 May 16 17:45:55.362735 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-2e03c907-2647-4652-b377-b25091a3f48b req-0ecd5281-cece-4664-ada7-e07046a5cf46 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035686 May 16 17:45:55.364875 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 344/713] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:46:15.067296 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d9ba6684-81c3-449d-b90f-b54dae310506 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:15.068363 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d9ba6684-81c3-449d-b90f-b54dae310506 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:15.076103 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d9ba6684-81c3-449d-b90f-b54dae310506 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:15.076550 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d9ba6684-81c3-449d-b90f-b54dae310506 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:15.077314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d9ba6684-81c3-449d-b90f-b54dae310506 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:15.077782 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d9ba6684-81c3-449d-b90f-b54dae310506 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:15.101381 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d9ba6684-81c3-449d-b90f-b54dae310506 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f/ips" status: 200 len: 149 microversion: 2.1 time: 0.041618 May 16 17:46:15.101975 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 370/714] 10.222.0.58 () {58 vars in 1247 bytes} [Mon May 16 17:46:15 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:46:16.434787 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-7136918a-8a10-4226-945d-b2f7c9a800f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56ce6fea-dd35-4b96-aea9-13f128ecb88d"}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:46:16.435934 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-7136918a-8a10-4226-945d-b2f7c9a800f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:16.442818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7136918a-8a10-4226-945d-b2f7c9a800f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:16.443264 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7136918a-8a10-4226-945d-b2f7c9a800f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:16.444008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7136918a-8a10-4226-945d-b2f7c9a800f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:16.444439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7136918a-8a10-4226-945d-b2f7c9a800f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:16.690531 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-7136918a-8a10-4226-945d-b2f7c9a800f1 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "POST /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260778 May 16 17:46:16.691175 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 345/715] 10.222.0.58 () {60 vars in 1322 bytes} [Mon May 16 17:46:16 2022] POST /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:46:23.285678 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ca02dd09-ebd2-48c5-943e-83cf5390da1a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:23.286193 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ca02dd09-ebd2-48c5-943e-83cf5390da1a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:23.293247 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ca02dd09-ebd2-48c5-943e-83cf5390da1a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:23.293752 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ca02dd09-ebd2-48c5-943e-83cf5390da1a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:23.294505 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ca02dd09-ebd2-48c5-943e-83cf5390da1a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:23.294938 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ca02dd09-ebd2-48c5-943e-83cf5390da1a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:23.376032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.objects.instance [None req-ca02dd09-ebd2-48c5-943e-83cf5390da1a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lazy-loading 'services' on Instance uuid a48d4742-7c3e-4568-8424-d73ce0bf371f {{(pid=128815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:46:23.450237 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ca02dd09-ebd2-48c5-943e-83cf5390da1a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f/os-volume_attachments/56ce6fea-dd35-4b96-aea9-13f128ecb88d" status: 202 len: 0 microversion: 2.1 time: 0.168561 May 16 17:46:23.450895 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 371/716] 10.222.0.58 () {58 vars in 1415 bytes} [Mon May 16 17:46:23 2022] DELETE /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f/os-volume_attachments/56ce6fea-dd35-4b96-aea9-13f128ecb88d => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:46:23.460510 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ea072833-d247-4694-b7a5-9ea02d27f33a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:23.461795 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-ea072833-d247-4694-b7a5-9ea02d27f33a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:23.468247 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ea072833-d247-4694-b7a5-9ea02d27f33a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:23.468818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ea072833-d247-4694-b7a5-9ea02d27f33a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:23.469661 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ea072833-d247-4694-b7a5-9ea02d27f33a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:23.470094 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ea072833-d247-4694-b7a5-9ea02d27f33a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:23.500796 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ea072833-d247-4694-b7a5-9ea02d27f33a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045044 May 16 17:46:23.501331 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 346/717] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:46:23 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:46:24.517575 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0039cc02-bc8d-40a7-a4a9-603694956760 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:24.518700 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-0039cc02-bc8d-40a7-a4a9-603694956760 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:24.526489 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0039cc02-bc8d-40a7-a4a9-603694956760 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:24.526990 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0039cc02-bc8d-40a7-a4a9-603694956760 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:24.527846 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0039cc02-bc8d-40a7-a4a9-603694956760 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:24.528317 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0039cc02-bc8d-40a7-a4a9-603694956760 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:24.560161 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-0039cc02-bc8d-40a7-a4a9-603694956760 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049312 May 16 17:46:24.560693 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 372/718] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:46:24 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 17:46:24.620090 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-8aa56d44-8939-4eea-a6b9-21609f1bd6e2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:24.620670 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-8aa56d44-8939-4eea-a6b9-21609f1bd6e2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:24.628661 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8aa56d44-8939-4eea-a6b9-21609f1bd6e2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:24.629087 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8aa56d44-8939-4eea-a6b9-21609f1bd6e2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:24.629885 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8aa56d44-8939-4eea-a6b9-21609f1bd6e2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:24.630315 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8aa56d44-8939-4eea-a6b9-21609f1bd6e2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:24.655433 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-8aa56d44-8939-4eea-a6b9-21609f1bd6e2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Going to try to terminate instance {{(pid=128816) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:46:24.739277 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-8aa56d44-8939-4eea-a6b9-21609f1bd6e2 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f" status: 204 len: 0 microversion: 2.1 time: 0.122764 May 16 17:46:24.739919 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 347/719] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:46:24 2022] DELETE /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:46:24.749924 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8479325f-b686-44d5-a1ce-46e84ed9d1fa tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:24.750633 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-8479325f-b686-44d5-a1ce-46e84ed9d1fa tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:24.756778 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8479325f-b686-44d5-a1ce-46e84ed9d1fa tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:24.757238 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8479325f-b686-44d5-a1ce-46e84ed9d1fa tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:24.758033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8479325f-b686-44d5-a1ce-46e84ed9d1fa tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:24.758469 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8479325f-b686-44d5-a1ce-46e84ed9d1fa tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:24.892422 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-8479325f-b686-44d5-a1ce-46e84ed9d1fa tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:24.903803 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-8479325f-b686-44d5-a1ce-46e84ed9d1fa tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f" status: 200 len: 1680 microversion: 2.1 time: 0.159269 May 16 17:46:24.904510 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 373/720] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:46:24 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:46:25.922608 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-92a9552e-1a4f-4122-9288-dd718e8182ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:25.923318 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-92a9552e-1a4f-4122-9288-dd718e8182ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:25.930475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-92a9552e-1a4f-4122-9288-dd718e8182ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:25.930928 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-92a9552e-1a4f-4122-9288-dd718e8182ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:25.931715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-92a9552e-1a4f-4122-9288-dd718e8182ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:25.932151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-92a9552e-1a4f-4122-9288-dd718e8182ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:26.072803 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-92a9552e-1a4f-4122-9288-dd718e8182ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:26.084025 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-92a9552e-1a4f-4122-9288-dd718e8182ea tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f" status: 200 len: 1680 microversion: 2.1 time: 0.165758 May 16 17:46:26.084669 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 348/721] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:46:25 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:46:27.105573 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-b47dcfb5-0df3-4dd1-bf3f-9ba22592788d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:27.106205 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b47dcfb5-0df3-4dd1-bf3f-9ba22592788d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:27.113317 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b47dcfb5-0df3-4dd1-bf3f-9ba22592788d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:27.113791 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b47dcfb5-0df3-4dd1-bf3f-9ba22592788d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:27.114598 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b47dcfb5-0df3-4dd1-bf3f-9ba22592788d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:27.115054 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b47dcfb5-0df3-4dd1-bf3f-9ba22592788d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:27.169711 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-d02ea1c4-a127-4f7a-8561-2b0e8b1b857e req-f157fc8a-dcbb-429c-8568-613540d63c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48d4742-7c3e-4568-8424-d73ce0bf371f", "name": "network-vif-deleted", "tag": "3b12e281-cf95-4d90-8772-1151abc09698"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:46:27.179764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-d02ea1c4-a127-4f7a-8561-2b0e8b1b857e req-f157fc8a-dcbb-429c-8568-613540d63c37 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:27.180508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-d02ea1c4-a127-4f7a-8561-2b0e8b1b857e req-f157fc8a-dcbb-429c-8568-613540d63c37 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:27.198140 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-d02ea1c4-a127-4f7a-8561-2b0e8b1b857e req-f157fc8a-dcbb-429c-8568-613540d63c37 service nova] Creating event network-vif-deleted:3b12e281-cf95-4d90-8772-1151abc09698 for instance a48d4742-7c3e-4568-8424-d73ce0bf371f on hv-cinder-83769 May 16 17:46:27.206477 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-d02ea1c4-a127-4f7a-8561-2b0e8b1b857e req-f157fc8a-dcbb-429c-8568-613540d63c37 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040524 May 16 17:46:27.207971 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 349/722] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:46:27.211887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b47dcfb5-0df3-4dd1-bf3f-9ba22592788d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6838738598ce4d2186e7c0b6547868f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c60c24806542e889c070d519172e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:27.223102 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-b47dcfb5-0df3-4dd1-bf3f-9ba22592788d tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f" status: 200 len: 1614 microversion: 2.1 time: 0.122784 May 16 17:46:27.224323 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 374/723] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:46:27 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f => generated 1614 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:46:28.241260 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-8fada741-7fed-4d18-9f5c-cb1068970b15 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:28.242016 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-8fada741-7fed-4d18-9f5c-cb1068970b15 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:28.249045 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8fada741-7fed-4d18-9f5c-cb1068970b15 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:28.249518 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8fada741-7fed-4d18-9f5c-cb1068970b15 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:28.250351 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8fada741-7fed-4d18-9f5c-cb1068970b15 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:28.250793 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8fada741-7fed-4d18-9f5c-cb1068970b15 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:28.264738 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-8fada741-7fed-4d18-9f5c-cb1068970b15 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] HTTP exception thrown: Instance a48d4742-7c3e-4568-8424-d73ce0bf371f could not be found. May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-8fada741-7fed-4d18-9f5c-cb1068970b15 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Request method failure captured: May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f HTTP/1.1 May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigox4BWkjUGbMIvOn7lTkLppnWsYzIVQtNJHubTanufmvEHsiu_ONp3auIJGxAXU0K5GHn7jQDnT6YubbdzHrAJT45fAGoePZ3wwIuaMH8qkH2BLOah56kKB6Od9VwHk7uC0dRignIhl6Vtrx_s0xElsY95RDLsFnhdltcQlhJ0yFrss May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 80c60c24806542e889c070d519172e79 May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:46:28.266459 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:46:28.267862 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80c60c24806542e889c070d519172e79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80c60c24806542e889c070d519172e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:46:28.267862 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:28.267862 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 80c60c24806542e889c070d519172e79 May 16 17:46:28.267862 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:28.267862 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:46:28.267862 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:46:28.267862 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:46:28.267862 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 6838738598ce4d2186e7c0b6547868f6 May 16 17:46:28.267862 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:46:28.267862 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:46:28.267862 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance a48d4742-7c3e-4568-8424-d73ce0bf371f could not be found. May 16 17:46:28.267862 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': 'a48d4742-7c3e-4568-8424-d73ce0bf371f'} May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48d4742-7c3e-4568-8424-d73ce0bf371f could not be found. May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:46:28.268648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:46:28.270202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:46:28.270202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:46:28.270202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:46:28.270202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:46:28.270202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:46:28.270202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:46:28.270202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:46:28.270202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48d4742-7c3e-4568-8424-d73ce0bf371f could not be found. May 16 17:46:28.270202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:28.270202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:28.270202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:28.270202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:28.270202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:28.270202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:28.270202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:46:28.270202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:46:28.270202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48d4742-7c3e-4568-8424-d73ce0bf371f could not be found. May 16 17:46:28.270202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:28.271636 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-8fada741-7fed-4d18-9f5c-cb1068970b15 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Returning 404 to user: Instance a48d4742-7c3e-4568-8424-d73ce0bf371f could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:46:28.271636 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-8fada741-7fed-4d18-9f5c-cb1068970b15 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f" status: 404 len: 111 microversion: 2.1 time: 0.031020 May 16 17:46:28.271636 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 350/724] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:46:28 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:46:28.276978 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-2608e4d0-70c7-49cb-8bce-c5187cfb5f92 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '.version_select at 0x7f79a49298b0>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:28.296865 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-2608e4d0-70c7-49cb-8bce-c5187cfb5f92 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355114172" status: 202 len: 0 microversion: 2.1 time: 0.023626 May 16 17:46:28.297496 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 375/725] 10.222.0.58 () {58 vars in 1220 bytes} [Mon May 16 17:46:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355114172 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 17:46:30.057792 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-bbcc11ba-1eff-4142-a77f-6ac490020a7f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:30.058280 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-bbcc11ba-1eff-4142-a77f-6ac490020a7f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:30.066316 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bbcc11ba-1eff-4142-a77f-6ac490020a7f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:30.066754 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bbcc11ba-1eff-4142-a77f-6ac490020a7f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:30.067517 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bbcc11ba-1eff-4142-a77f-6ac490020a7f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:30.067950 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bbcc11ba-1eff-4142-a77f-6ac490020a7f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:30.081711 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-bbcc11ba-1eff-4142-a77f-6ac490020a7f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] HTTP exception thrown: Instance a48d4742-7c3e-4568-8424-d73ce0bf371f could not be found. May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-bbcc11ba-1eff-4142-a77f-6ac490020a7f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Request method failure captured: May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: DELETE /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f HTTP/1.1 May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigox4BWkjUGbMIvOn7lTkLppnWsYzIVQtNJHubTanufmvEHsiu_ONp3auIJGxAXU0K5GHn7jQDnT6YubbdzHrAJT45fAGoePZ3wwIuaMH8qkH2BLOah56kKB6Od9VwHk7uC0dRignIhl6Vtrx_s0xElsY95RDLsFnhdltcQlhJ0yFrss May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 80c60c24806542e889c070d519172e79 May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:46:30.083222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:46:30.084754 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80c60c24806542e889c070d519172e79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80c60c24806542e889c070d519172e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:46:30.084754 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:30.084754 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 80c60c24806542e889c070d519172e79 May 16 17:46:30.084754 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:30.084754 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:46:30.084754 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:46:30.084754 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:46:30.084754 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 6838738598ce4d2186e7c0b6547868f6 May 16 17:46:30.084754 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:46:30.084754 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:46:30.084754 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance a48d4742-7c3e-4568-8424-d73ce0bf371f could not be found. May 16 17:46:30.084754 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': 'a48d4742-7c3e-4568-8424-d73ce0bf371f'} May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48d4742-7c3e-4568-8424-d73ce0bf371f could not be found. May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:46:30.085565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48d4742-7c3e-4568-8424-d73ce0bf371f could not be found. May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48d4742-7c3e-4568-8424-d73ce0bf371f could not be found. May 16 17:46:30.086715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:30.087858 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-bbcc11ba-1eff-4142-a77f-6ac490020a7f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Returning 404 to user: Instance a48d4742-7c3e-4568-8424-d73ce0bf371f could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:46:30.087858 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-bbcc11ba-1eff-4142-a77f-6ac490020a7f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f" status: 404 len: 111 microversion: 2.1 time: 0.032435 May 16 17:46:30.087858 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 351/726] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:46:30 2022] DELETE /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:46:30.093639 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-59f07fdf-ea67-4ba7-af0e-3bdc7f82647a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:30.094201 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-59f07fdf-ea67-4ba7-af0e-3bdc7f82647a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: a48d4742-7c3e-4568-8424-d73ce0bf371f] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:30.101137 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-59f07fdf-ea67-4ba7-af0e-3bdc7f82647a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:30.101616 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-59f07fdf-ea67-4ba7-af0e-3bdc7f82647a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:30.102381 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-59f07fdf-ea67-4ba7-af0e-3bdc7f82647a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:30.102812 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-59f07fdf-ea67-4ba7-af0e-3bdc7f82647a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:30.116249 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-59f07fdf-ea67-4ba7-af0e-3bdc7f82647a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] HTTP exception thrown: Instance a48d4742-7c3e-4568-8424-d73ce0bf371f could not be found. May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-59f07fdf-ea67-4ba7-af0e-3bdc7f82647a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Request method failure captured: May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f HTTP/1.1 May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigox4BWkjUGbMIvOn7lTkLppnWsYzIVQtNJHubTanufmvEHsiu_ONp3auIJGxAXU0K5GHn7jQDnT6YubbdzHrAJT45fAGoePZ3wwIuaMH8qkH2BLOah56kKB6Od9VwHk7uC0dRignIhl6Vtrx_s0xElsY95RDLsFnhdltcQlhJ0yFrss May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 80c60c24806542e889c070d519172e79 May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:46:30.117929 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:46:30.119412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80c60c24806542e889c070d519172e79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80c60c24806542e889c070d519172e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:46:30.119412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:30.119412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 80c60c24806542e889c070d519172e79 May 16 17:46:30.119412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:30.119412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:46:30.119412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:46:30.119412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:46:30.119412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: 6838738598ce4d2186e7c0b6547868f6 May 16 17:46:30.119412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:46:30.119412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:46:30.119412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance a48d4742-7c3e-4568-8424-d73ce0bf371f could not be found. May 16 17:46:30.119412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': 'a48d4742-7c3e-4568-8424-d73ce0bf371f'} May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48d4742-7c3e-4568-8424-d73ce0bf371f could not be found. May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:46:30.120314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:46:30.121715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:46:30.121715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:46:30.121715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:46:30.121715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:46:30.121715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:46:30.121715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:46:30.121715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:46:30.121715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48d4742-7c3e-4568-8424-d73ce0bf371f could not be found. May 16 17:46:30.121715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:30.121715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:30.121715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:30.121715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:30.121715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:30.121715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:30.121715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:46:30.121715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:46:30.121715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48d4742-7c3e-4568-8424-d73ce0bf371f could not be found. May 16 17:46:30.121715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:30.122888 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-59f07fdf-ea67-4ba7-af0e-3bdc7f82647a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Returning 404 to user: Instance a48d4742-7c3e-4568-8424-d73ce0bf371f could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:46:30.122888 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-59f07fdf-ea67-4ba7-af0e-3bdc7f82647a tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f" status: 404 len: 111 microversion: 2.1 time: 0.030161 May 16 17:46:30.122888 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 376/727] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:46:30 2022] GET /compute/v2.1/servers/a48d4742-7c3e-4568-8424-d73ce0bf371f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:46:31.198981 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ef725f33-4395-42f2-99fc-8e4a4538c9b3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:31.199621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-ef725f33-4395-42f2-99fc-8e4a4538c9b3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:31.207033 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ef725f33-4395-42f2-99fc-8e4a4538c9b3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:31.207504 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ef725f33-4395-42f2-99fc-8e4a4538c9b3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:31.208286 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ef725f33-4395-42f2-99fc-8e4a4538c9b3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:31.208716 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ef725f33-4395-42f2-99fc-8e4a4538c9b3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:31.232328 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ef725f33-4395-42f2-99fc-8e4a4538c9b3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e/ips" status: 200 len: 151 microversion: 2.20 time: 0.039668 May 16 17:46:31.232884 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 352/728] 10.222.0.58 () {60 vars in 1288 bytes} [Mon May 16 17:46:31 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:46:31.266056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-127f3851-0cfc-49a2-8316-7b2ca65eb2f3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:31.266567 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-127f3851-0cfc-49a2-8316-7b2ca65eb2f3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:31.273246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-127f3851-0cfc-49a2-8316-7b2ca65eb2f3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:31.273757 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-127f3851-0cfc-49a2-8316-7b2ca65eb2f3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:31.274551 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-127f3851-0cfc-49a2-8316-7b2ca65eb2f3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:31.275019 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-127f3851-0cfc-49a2-8316-7b2ca65eb2f3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:31.288746 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-127f3851-0cfc-49a2-8316-7b2ca65eb2f3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] HTTP exception thrown: Instance 10f2449e-7706-405a-9dc2-3c52e3df0489 could not be found. May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-127f3851-0cfc-49a2-8316-7b2ca65eb2f3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Request method failure captured: May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: DELETE /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 HTTP/1.1 May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigox4BWkjUGbMIvOn7lTkLppnWsYzIVQtNJHubTanufmvEHsiu_ONp3auIJGxAXU0K5GHn7jQDnT6YubbdzHrAJT45fAGoePZ3wwIuaMH8qkH2BLOah56kKB6Od9VwHk7uC0dRignIhl6Vtrx_s0xElsY95RDLsFnhdltcQlhJ0yFrss May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 80c60c24806542e889c070d519172e79 May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:46:31.290656 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:46:31.292174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80c60c24806542e889c070d519172e79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80c60c24806542e889c070d519172e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:46:31.292174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:31.292174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 80c60c24806542e889c070d519172e79 May 16 17:46:31.292174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:31.292174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:46:31.292174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:46:31.292174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:46:31.292174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: 6838738598ce4d2186e7c0b6547868f6 May 16 17:46:31.292174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:46:31.292174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:46:31.292174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance 10f2449e-7706-405a-9dc2-3c52e3df0489 could not be found. May 16 17:46:31.292174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': '10f2449e-7706-405a-9dc2-3c52e3df0489'} May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10f2449e-7706-405a-9dc2-3c52e3df0489 could not be found. May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:46:31.293128 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10f2449e-7706-405a-9dc2-3c52e3df0489 could not be found. May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10f2449e-7706-405a-9dc2-3c52e3df0489 could not be found. May 16 17:46:31.294549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:31.295977 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-127f3851-0cfc-49a2-8316-7b2ca65eb2f3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Returning 404 to user: Instance 10f2449e-7706-405a-9dc2-3c52e3df0489 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:46:31.295977 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-127f3851-0cfc-49a2-8316-7b2ca65eb2f3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "DELETE /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 404 len: 111 microversion: 2.1 time: 0.030109 May 16 17:46:31.295977 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 377/729] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:46:31 2022] DELETE /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:46:31.300589 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-45be3834-42ed-4d75-8bf9-f6498f88a4b3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:31.301194 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-45be3834-42ed-4d75-8bf9-f6498f88a4b3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 10f2449e-7706-405a-9dc2-3c52e3df0489] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:31.307038 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-45be3834-42ed-4d75-8bf9-f6498f88a4b3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:31.307484 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-45be3834-42ed-4d75-8bf9-f6498f88a4b3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:31.308245 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-45be3834-42ed-4d75-8bf9-f6498f88a4b3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:31.308673 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-45be3834-42ed-4d75-8bf9-f6498f88a4b3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:31.321915 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-45be3834-42ed-4d75-8bf9-f6498f88a4b3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] HTTP exception thrown: Instance 10f2449e-7706-405a-9dc2-3c52e3df0489 could not be found. May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-45be3834-42ed-4d75-8bf9-f6498f88a4b3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Request method failure captured: May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 HTTP/1.1 May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigox4BWkjUGbMIvOn7lTkLppnWsYzIVQtNJHubTanufmvEHsiu_ONp3auIJGxAXU0K5GHn7jQDnT6YubbdzHrAJT45fAGoePZ3wwIuaMH8qkH2BLOah56kKB6Od9VwHk7uC0dRignIhl6Vtrx_s0xElsY95RDLsFnhdltcQlhJ0yFrss May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 80c60c24806542e889c070d519172e79 May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:46:31.323465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:46:31.325652 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80c60c24806542e889c070d519172e79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80c60c24806542e889c070d519172e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:46:31.325652 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:31.325652 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 80c60c24806542e889c070d519172e79 May 16 17:46:31.325652 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:31.325652 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:46:31.325652 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:46:31.325652 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:46:31.325652 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 6838738598ce4d2186e7c0b6547868f6 May 16 17:46:31.325652 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:46:31.325652 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:46:31.325652 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance 10f2449e-7706-405a-9dc2-3c52e3df0489 could not be found. May 16 17:46:31.325652 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': '10f2449e-7706-405a-9dc2-3c52e3df0489'} May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10f2449e-7706-405a-9dc2-3c52e3df0489 could not be found. May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:46:31.326515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:46:31.327901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:46:31.327901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:46:31.327901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:46:31.327901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:46:31.327901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:46:31.327901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:46:31.327901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:46:31.327901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10f2449e-7706-405a-9dc2-3c52e3df0489 could not be found. May 16 17:46:31.327901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:31.327901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:31.327901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:31.327901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:31.327901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:31.327901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:31.327901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:46:31.327901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:46:31.327901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10f2449e-7706-405a-9dc2-3c52e3df0489 could not be found. May 16 17:46:31.327901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:31.329169 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-45be3834-42ed-4d75-8bf9-f6498f88a4b3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Returning 404 to user: Instance 10f2449e-7706-405a-9dc2-3c52e3df0489 could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:46:31.329169 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-45be3834-42ed-4d75-8bf9-f6498f88a4b3 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489" status: 404 len: 111 microversion: 2.1 time: 0.028166 May 16 17:46:31.329169 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 353/730] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:46:31 2022] GET /compute/v2.1/servers/10f2449e-7706-405a-9dc2-3c52e3df0489 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:46:31.333722 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4696ba8b-7d8d-4c1f-869e-fea417232e53 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:31.334348 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-4696ba8b-7d8d-4c1f-869e-fea417232e53 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:31.340521 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4696ba8b-7d8d-4c1f-869e-fea417232e53 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:31.340972 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4696ba8b-7d8d-4c1f-869e-fea417232e53 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:31.341895 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4696ba8b-7d8d-4c1f-869e-fea417232e53 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:31.342337 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4696ba8b-7d8d-4c1f-869e-fea417232e53 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:31.355801 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-4696ba8b-7d8d-4c1f-869e-fea417232e53 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] HTTP exception thrown: Instance cc187581-b958-457b-8aca-7774e8416ada could not be found. May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4696ba8b-7d8d-4c1f-869e-fea417232e53 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Request method failure captured: May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: DELETE /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada HTTP/1.1 May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigox4BWkjUGbMIvOn7lTkLppnWsYzIVQtNJHubTanufmvEHsiu_ONp3auIJGxAXU0K5GHn7jQDnT6YubbdzHrAJT45fAGoePZ3wwIuaMH8qkH2BLOah56kKB6Od9VwHk7uC0dRignIhl6Vtrx_s0xElsY95RDLsFnhdltcQlhJ0yFrss May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 80c60c24806542e889c070d519172e79 May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:46:31.357324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:46:31.358696 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80c60c24806542e889c070d519172e79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80c60c24806542e889c070d519172e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:46:31.358696 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:31.358696 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 80c60c24806542e889c070d519172e79 May 16 17:46:31.358696 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:31.358696 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:46:31.358696 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:46:31.358696 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:46:31.358696 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: 6838738598ce4d2186e7c0b6547868f6 May 16 17:46:31.358696 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:46:31.358696 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:46:31.358696 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance cc187581-b958-457b-8aca-7774e8416ada could not be found. May 16 17:46:31.358696 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': 'cc187581-b958-457b-8aca-7774e8416ada'} May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc187581-b958-457b-8aca-7774e8416ada could not be found. May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:46:31.359458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc187581-b958-457b-8aca-7774e8416ada could not be found. May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc187581-b958-457b-8aca-7774e8416ada could not be found. May 16 17:46:31.360614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:31.362016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4696ba8b-7d8d-4c1f-869e-fea417232e53 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Returning 404 to user: Instance cc187581-b958-457b-8aca-7774e8416ada could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:46:31.362016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-4696ba8b-7d8d-4c1f-869e-fea417232e53 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 404 len: 111 microversion: 2.1 time: 0.028990 May 16 17:46:31.362016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 378/731] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:46:31 2022] DELETE /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:46:31.367305 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9111ee2a-b1a2-4f92-9f6e-8e69e030b35f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:31.367921 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-9111ee2a-b1a2-4f92-9f6e-8e69e030b35f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: cc187581-b958-457b-8aca-7774e8416ada] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:31.373774 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9111ee2a-b1a2-4f92-9f6e-8e69e030b35f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:31.374223 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9111ee2a-b1a2-4f92-9f6e-8e69e030b35f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:31.375053 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9111ee2a-b1a2-4f92-9f6e-8e69e030b35f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:31.375492 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9111ee2a-b1a2-4f92-9f6e-8e69e030b35f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:31.392056 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-9111ee2a-b1a2-4f92-9f6e-8e69e030b35f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] HTTP exception thrown: Instance cc187581-b958-457b-8aca-7774e8416ada could not be found. May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9111ee2a-b1a2-4f92-9f6e-8e69e030b35f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Request method failure captured: May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada HTTP/1.1 May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigox4BWkjUGbMIvOn7lTkLppnWsYzIVQtNJHubTanufmvEHsiu_ONp3auIJGxAXU0K5GHn7jQDnT6YubbdzHrAJT45fAGoePZ3wwIuaMH8qkH2BLOah56kKB6Od9VwHk7uC0dRignIhl6Vtrx_s0xElsY95RDLsFnhdltcQlhJ0yFrss May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 80c60c24806542e889c070d519172e79 May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:46:31.393737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:46:31.395576 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80c60c24806542e889c070d519172e79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80c60c24806542e889c070d519172e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:46:31.395576 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:31.395576 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 80c60c24806542e889c070d519172e79 May 16 17:46:31.395576 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:31.395576 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:46:31.395576 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:46:31.395576 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:46:31.395576 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 6838738598ce4d2186e7c0b6547868f6 May 16 17:46:31.395576 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:46:31.395576 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:46:31.395576 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance cc187581-b958-457b-8aca-7774e8416ada could not be found. May 16 17:46:31.395576 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': 'cc187581-b958-457b-8aca-7774e8416ada'} May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc187581-b958-457b-8aca-7774e8416ada could not be found. May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:46:31.396475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:46:31.397806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:46:31.397806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:46:31.397806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:46:31.397806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:46:31.397806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:46:31.397806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:46:31.397806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:46:31.397806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc187581-b958-457b-8aca-7774e8416ada could not be found. May 16 17:46:31.397806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:31.397806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:31.397806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:31.397806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:31.397806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:31.397806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:31.397806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:46:31.397806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:46:31.397806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc187581-b958-457b-8aca-7774e8416ada could not be found. May 16 17:46:31.397806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:31.399670 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9111ee2a-b1a2-4f92-9f6e-8e69e030b35f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Returning 404 to user: Instance cc187581-b958-457b-8aca-7774e8416ada could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:46:31.399670 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-9111ee2a-b1a2-4f92-9f6e-8e69e030b35f tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada" status: 404 len: 111 microversion: 2.1 time: 0.031748 May 16 17:46:31.399670 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 354/732] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:46:31 2022] GET /compute/v2.1/servers/cc187581-b958-457b-8aca-7774e8416ada => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:46:32.545041 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ac117d6b-9ebb-4359-accf-aa0a83ab1001 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:32.545652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ac117d6b-9ebb-4359-accf-aa0a83ab1001 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:32.552794 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ac117d6b-9ebb-4359-accf-aa0a83ab1001 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:32.553245 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ac117d6b-9ebb-4359-accf-aa0a83ab1001 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:32.554061 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ac117d6b-9ebb-4359-accf-aa0a83ab1001 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:32.554500 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ac117d6b-9ebb-4359-accf-aa0a83ab1001 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:32.568290 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-ac117d6b-9ebb-4359-accf-aa0a83ab1001 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] HTTP exception thrown: Instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 could not be found. May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ac117d6b-9ebb-4359-accf-aa0a83ab1001 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Request method failure captured: May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: DELETE /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 HTTP/1.1 May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigox4BWkjUGbMIvOn7lTkLppnWsYzIVQtNJHubTanufmvEHsiu_ONp3auIJGxAXU0K5GHn7jQDnT6YubbdzHrAJT45fAGoePZ3wwIuaMH8qkH2BLOah56kKB6Od9VwHk7uC0dRignIhl6Vtrx_s0xElsY95RDLsFnhdltcQlhJ0yFrss May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 80c60c24806542e889c070d519172e79 May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:46:32.569880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:46:32.571222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80c60c24806542e889c070d519172e79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80c60c24806542e889c070d519172e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:46:32.571222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:32.571222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 80c60c24806542e889c070d519172e79 May 16 17:46:32.571222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:32.571222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:46:32.571222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:46:32.571222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:46:32.571222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: 6838738598ce4d2186e7c0b6547868f6 May 16 17:46:32.571222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:46:32.571222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:46:32.571222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 could not be found. May 16 17:46:32.571222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': '79ea3f0a-7300-45ed-8778-4ca04699ff84'} May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 could not be found. May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:46:32.572366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 could not be found. May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 could not be found. May 16 17:46:32.573676 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:46:32.575333 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ac117d6b-9ebb-4359-accf-aa0a83ab1001 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Returning 404 to user: Instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:46:32.575333 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ac117d6b-9ebb-4359-accf-aa0a83ab1001 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "DELETE /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 404 len: 111 microversion: 2.1 time: 0.031518 May 16 17:46:32.575333 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 379/733] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:46:32 2022] DELETE /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:46:32.579876 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d91e48a5-c03d-4678-ab91-6b37aab5ab16 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:32.580501 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d91e48a5-c03d-4678-ab91-6b37aab5ab16 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] [instance: 79ea3f0a-7300-45ed-8778-4ca04699ff84] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:32.586913 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d91e48a5-c03d-4678-ab91-6b37aab5ab16 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:32.587359 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d91e48a5-c03d-4678-ab91-6b37aab5ab16 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:32.588122 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d91e48a5-c03d-4678-ab91-6b37aab5ab16 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:32.588549 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d91e48a5-c03d-4678-ab91-6b37aab5ab16 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:32.602368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-d91e48a5-c03d-4678-ab91-6b37aab5ab16 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] HTTP exception thrown: Instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 could not be found. May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d91e48a5-c03d-4678-ab91-6b37aab5ab16 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Request method failure captured: May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 HTTP/1.1 May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigox4BWkjUGbMIvOn7lTkLppnWsYzIVQtNJHubTanufmvEHsiu_ONp3auIJGxAXU0K5GHn7jQDnT6YubbdzHrAJT45fAGoePZ3wwIuaMH8qkH2BLOah56kKB6Od9VwHk7uC0dRignIhl6Vtrx_s0xElsY95RDLsFnhdltcQlhJ0yFrss May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 80c60c24806542e889c070d519172e79 May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:46:32.603877 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:46:32.605395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80c60c24806542e889c070d519172e79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80c60c24806542e889c070d519172e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80c60c24806542e889c070d519172e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:46:32.605395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:32.605395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 80c60c24806542e889c070d519172e79 May 16 17:46:32.605395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1095848132 May 16 17:46:32.605395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:46:32.605395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:46:32.605395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:46:32.605395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 6838738598ce4d2186e7c0b6547868f6 May 16 17:46:32.605395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-AttachVolumeNegativeTest-1095848132-project May 16 17:46:32.605395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:46:32.605395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 could not be found. May 16 17:46:32.605395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': '79ea3f0a-7300-45ed-8778-4ca04699ff84'} May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 could not be found. May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:46:32.606833 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:46:32.608158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:46:32.608158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:46:32.608158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:46:32.608158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:46:32.608158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:46:32.608158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:46:32.608158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:46:32.608158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 could not be found. May 16 17:46:32.608158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:32.608158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:32.608158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:32.608158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:32.608158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:32.608158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:32.608158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:46:32.608158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:46:32.608158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 could not be found. May 16 17:46:32.608158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:32.609515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d91e48a5-c03d-4678-ab91-6b37aab5ab16 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] Returning 404 to user: Instance 79ea3f0a-7300-45ed-8778-4ca04699ff84 could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:46:32.609515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d91e48a5-c03d-4678-ab91-6b37aab5ab16 tempest-AttachVolumeNegativeTest-1095848132 tempest-AttachVolumeNegativeTest-1095848132-project] 10.222.0.58 "GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84" status: 404 len: 111 microversion: 2.1 time: 0.029270 May 16 17:46:32.609515 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 355/734] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:46:32 2022] GET /compute/v2.1/servers/79ea3f0a-7300-45ed-8778-4ca04699ff84 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:46:33.061315 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8bb44429-423a-4a9b-bee4-fe376c763194 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:46:33.061962 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-8bb44429-423a-4a9b-bee4-fe376c763194 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:33.068040 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8bb44429-423a-4a9b-bee4-fe376c763194 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:33.068490 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8bb44429-423a-4a9b-bee4-fe376c763194 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:33.069246 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8bb44429-423a-4a9b-bee4-fe376c763194 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:33.069710 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8bb44429-423a-4a9b-bee4-fe376c763194 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:33.091995 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.objects.instance [None req-8bb44429-423a-4a9b-bee4-fe376c763194 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lazy-loading 'flavor' on Instance uuid 6dc200e3-53ea-4163-8472-0a5e8c70f07e {{(pid=128815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:46:33.360956 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-8bb44429-423a-4a9b-bee4-fe376c763194 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "POST /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e/action" status: 202 len: 0 microversion: 2.20 time: 0.303753 May 16 17:46:33.361668 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 380/735] 10.222.0.58 () {62 vars in 1318 bytes} [Mon May 16 17:46:33 2022] POST /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 17:46:33.369957 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f81548ae-a60c-4969-b462-40fab9034cad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:33.370990 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-f81548ae-a60c-4969-b462-40fab9034cad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:33.377332 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f81548ae-a60c-4969-b462-40fab9034cad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:33.378143 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f81548ae-a60c-4969-b462-40fab9034cad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:33.379012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f81548ae-a60c-4969-b462-40fab9034cad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:33.379650 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f81548ae-a60c-4969-b462-40fab9034cad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:33.581765 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f81548ae-a60c-4969-b462-40fab9034cad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:33.590506 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f81548ae-a60c-4969-b462-40fab9034cad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:33.591961 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f81548ae-a60c-4969-b462-40fab9034cad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:33.593113 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f81548ae-a60c-4969-b462-40fab9034cad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1722 microversion: 2.20 time: 0.227157 May 16 17:46:33.593967 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 356/736] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:33 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:34.613557 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-7ae73e16-1f9b-427d-8695-73e665dac8a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:34.614410 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-7ae73e16-1f9b-427d-8695-73e665dac8a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:34.622350 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7ae73e16-1f9b-427d-8695-73e665dac8a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:34.622812 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7ae73e16-1f9b-427d-8695-73e665dac8a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:34.623768 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7ae73e16-1f9b-427d-8695-73e665dac8a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:34.624454 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7ae73e16-1f9b-427d-8695-73e665dac8a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:34.800438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-7ae73e16-1f9b-427d-8695-73e665dac8a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:34.808786 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-7ae73e16-1f9b-427d-8695-73e665dac8a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:34.810313 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-7ae73e16-1f9b-427d-8695-73e665dac8a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:34.811489 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-7ae73e16-1f9b-427d-8695-73e665dac8a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1722 microversion: 2.20 time: 0.202908 May 16 17:46:34.812032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 381/737] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:34 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:35.830620 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-20672493-d2fa-4c91-bfd2-b05a908b0815 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:35.831312 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-20672493-d2fa-4c91-bfd2-b05a908b0815 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:35.838075 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-20672493-d2fa-4c91-bfd2-b05a908b0815 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:35.838630 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-20672493-d2fa-4c91-bfd2-b05a908b0815 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:35.839488 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-20672493-d2fa-4c91-bfd2-b05a908b0815 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:35.839914 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-20672493-d2fa-4c91-bfd2-b05a908b0815 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:35.990313 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-20672493-d2fa-4c91-bfd2-b05a908b0815 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:35.998503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-20672493-d2fa-4c91-bfd2-b05a908b0815 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:36.000067 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-20672493-d2fa-4c91-bfd2-b05a908b0815 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:36.001208 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-20672493-d2fa-4c91-bfd2-b05a908b0815 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1722 microversion: 2.20 time: 0.174618 May 16 17:46:36.009967 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 357/738] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:35 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:37.019483 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-06d6043e-8f8d-4491-b033-5dec60088240 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:37.020091 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-06d6043e-8f8d-4491-b033-5dec60088240 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:37.026617 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-06d6043e-8f8d-4491-b033-5dec60088240 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:37.027096 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-06d6043e-8f8d-4491-b033-5dec60088240 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:37.027865 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-06d6043e-8f8d-4491-b033-5dec60088240 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:37.028327 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-06d6043e-8f8d-4491-b033-5dec60088240 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:37.160403 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-06d6043e-8f8d-4491-b033-5dec60088240 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:37.168613 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-06d6043e-8f8d-4491-b033-5dec60088240 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:37.170156 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-06d6043e-8f8d-4491-b033-5dec60088240 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:37.171406 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-06d6043e-8f8d-4491-b033-5dec60088240 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1722 microversion: 2.20 time: 0.155789 May 16 17:46:37.171959 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 382/739] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:37 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:38.190909 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-0582ce4e-4ceb-4885-8eb3-f15731c29ad7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:38.191565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-0582ce4e-4ceb-4885-8eb3-f15731c29ad7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:38.198452 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0582ce4e-4ceb-4885-8eb3-f15731c29ad7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:38.199097 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0582ce4e-4ceb-4885-8eb3-f15731c29ad7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:38.199848 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0582ce4e-4ceb-4885-8eb3-f15731c29ad7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:38.200377 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-0582ce4e-4ceb-4885-8eb3-f15731c29ad7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:38.337647 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-0582ce4e-4ceb-4885-8eb3-f15731c29ad7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:38.345661 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-0582ce4e-4ceb-4885-8eb3-f15731c29ad7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:38.347181 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-0582ce4e-4ceb-4885-8eb3-f15731c29ad7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:38.348340 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-0582ce4e-4ceb-4885-8eb3-f15731c29ad7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1722 microversion: 2.20 time: 0.161582 May 16 17:46:38.348933 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 358/740] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:38 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:39.366556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f8c4fb85-2b52-4b33-b688-96ea7b0b1528 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:39.367155 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-f8c4fb85-2b52-4b33-b688-96ea7b0b1528 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:39.373761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f8c4fb85-2b52-4b33-b688-96ea7b0b1528 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:39.374207 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f8c4fb85-2b52-4b33-b688-96ea7b0b1528 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:39.374990 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f8c4fb85-2b52-4b33-b688-96ea7b0b1528 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:39.375413 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f8c4fb85-2b52-4b33-b688-96ea7b0b1528 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:39.510237 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-f8c4fb85-2b52-4b33-b688-96ea7b0b1528 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:39.520200 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-f8c4fb85-2b52-4b33-b688-96ea7b0b1528 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:39.522184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-f8c4fb85-2b52-4b33-b688-96ea7b0b1528 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:39.523549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f8c4fb85-2b52-4b33-b688-96ea7b0b1528 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1722 microversion: 2.20 time: 0.160968 May 16 17:46:39.524529 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 383/741] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:39 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:40.541966 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-832c1fe2-a399-4a8b-b17b-76e2a6f99491 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:40.542535 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-832c1fe2-a399-4a8b-b17b-76e2a6f99491 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:40.549403 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-832c1fe2-a399-4a8b-b17b-76e2a6f99491 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:40.549880 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-832c1fe2-a399-4a8b-b17b-76e2a6f99491 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:40.550680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-832c1fe2-a399-4a8b-b17b-76e2a6f99491 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:40.551054 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-832c1fe2-a399-4a8b-b17b-76e2a6f99491 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:40.738965 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-832c1fe2-a399-4a8b-b17b-76e2a6f99491 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:40.747435 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-832c1fe2-a399-4a8b-b17b-76e2a6f99491 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:40.748938 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-832c1fe2-a399-4a8b-b17b-76e2a6f99491 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:40.750140 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-832c1fe2-a399-4a8b-b17b-76e2a6f99491 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1722 microversion: 2.20 time: 0.212398 May 16 17:46:40.750938 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 359/742] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:40 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:41.171573 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-dc69efba-c045-40e6-8136-a787f9130b43 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:41.172263 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-dc69efba-c045-40e6-8136-a787f9130b43 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:41.173932 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-678050c2-5220-4813-a11c-3fae46eab69d req-a183bcde-4b99-451f-a03a-97375e2b1c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "643ca394-14c0-407b-be2a-3616138ebdb6", "tag": "d3d402b3-9560-4542-9028-c21ffae8c316"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:46:41.179652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dc69efba-c045-40e6-8136-a787f9130b43 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:41.180103 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dc69efba-c045-40e6-8136-a787f9130b43 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:41.180899 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dc69efba-c045-40e6-8136-a787f9130b43 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:41.181334 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dc69efba-c045-40e6-8136-a787f9130b43 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:41.184310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-678050c2-5220-4813-a11c-3fae46eab69d req-a183bcde-4b99-451f-a03a-97375e2b1c0b service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:41.185815 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-678050c2-5220-4813-a11c-3fae46eab69d req-a183bcde-4b99-451f-a03a-97375e2b1c0b service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:41.198595 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-678050c2-5220-4813-a11c-3fae46eab69d req-a183bcde-4b99-451f-a03a-97375e2b1c0b service nova] Creating event network-changed:d3d402b3-9560-4542-9028-c21ffae8c316 for instance 643ca394-14c0-407b-be2a-3616138ebdb6 on hv-cinder-83769 May 16 17:46:41.208400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-678050c2-5220-4813-a11c-3fae46eab69d req-a183bcde-4b99-451f-a03a-97375e2b1c0b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038398 May 16 17:46:41.210844 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 360/743] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:46:41.217430 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-dc69efba-c045-40e6-8136-a787f9130b43 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Going to try to terminate instance {{(pid=128815) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:46:41.305875 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-dc69efba-c045-40e6-8136-a787f9130b43 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "DELETE /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 204 len: 0 microversion: 2.1 time: 0.137481 May 16 17:46:41.307568 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 384/744] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:46:41 2022] DELETE /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:46:41.318066 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-3b0adda6-3292-4178-9ba6-36625953778e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:41.319990 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-3b0adda6-3292-4178-9ba6-36625953778e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:41.327213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3b0adda6-3292-4178-9ba6-36625953778e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:41.327708 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3b0adda6-3292-4178-9ba6-36625953778e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:41.328484 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3b0adda6-3292-4178-9ba6-36625953778e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:41.328908 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3b0adda6-3292-4178-9ba6-36625953778e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:41.464156 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-3b0adda6-3292-4178-9ba6-36625953778e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:41.471843 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-3b0adda6-3292-4178-9ba6-36625953778e tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1568 microversion: 2.1 time: 0.158806 May 16 17:46:41.472421 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 361/745] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:46:41 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:46:41.769064 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-1611e051-65b5-4e96-b80a-655574299f82 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:41.769749 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-1611e051-65b5-4e96-b80a-655574299f82 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:41.775730 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1611e051-65b5-4e96-b80a-655574299f82 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:41.776177 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1611e051-65b5-4e96-b80a-655574299f82 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:41.776931 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1611e051-65b5-4e96-b80a-655574299f82 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:41.777388 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1611e051-65b5-4e96-b80a-655574299f82 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:41.912291 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-1611e051-65b5-4e96-b80a-655574299f82 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:41.920801 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-1611e051-65b5-4e96-b80a-655574299f82 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:41.922363 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-1611e051-65b5-4e96-b80a-655574299f82 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:41.923561 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-1611e051-65b5-4e96-b80a-655574299f82 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1722 microversion: 2.20 time: 0.158980 May 16 17:46:41.924124 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 385/746] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:41 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:42.490453 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-97f02a6a-54df-4aa1-a233-c082cc98d061 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:42.491376 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-97f02a6a-54df-4aa1-a233-c082cc98d061 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:42.498241 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-97f02a6a-54df-4aa1-a233-c082cc98d061 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:42.498690 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-97f02a6a-54df-4aa1-a233-c082cc98d061 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:42.499458 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-97f02a6a-54df-4aa1-a233-c082cc98d061 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:42.500183 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-97f02a6a-54df-4aa1-a233-c082cc98d061 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:42.633020 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-97f02a6a-54df-4aa1-a233-c082cc98d061 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:42.640644 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-97f02a6a-54df-4aa1-a233-c082cc98d061 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1568 microversion: 2.1 time: 0.154415 May 16 17:46:42.641649 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 362/747] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:46:42 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:46:42.942132 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0809ae7c-39ac-4456-887e-575ffa392eb3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:42.942707 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-0809ae7c-39ac-4456-887e-575ffa392eb3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:42.949014 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0809ae7c-39ac-4456-887e-575ffa392eb3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:42.949791 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0809ae7c-39ac-4456-887e-575ffa392eb3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:42.950741 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0809ae7c-39ac-4456-887e-575ffa392eb3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:42.951179 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0809ae7c-39ac-4456-887e-575ffa392eb3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:43.100138 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-0809ae7c-39ac-4456-887e-575ffa392eb3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:43.108393 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-0809ae7c-39ac-4456-887e-575ffa392eb3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:43.109985 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-0809ae7c-39ac-4456-887e-575ffa392eb3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:43.111151 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-0809ae7c-39ac-4456-887e-575ffa392eb3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1722 microversion: 2.20 time: 0.173002 May 16 17:46:43.111759 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 386/748] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:42 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:43.661017 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-998c1c69-1ba5-48df-83d4-cf533fedae80 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:43.662101 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-998c1c69-1ba5-48df-83d4-cf533fedae80 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:43.673249 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-998c1c69-1ba5-48df-83d4-cf533fedae80 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:43.674061 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-998c1c69-1ba5-48df-83d4-cf533fedae80 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:43.675310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-998c1c69-1ba5-48df-83d4-cf533fedae80 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:43.676034 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-998c1c69-1ba5-48df-83d4-cf533fedae80 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:43.881619 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-998c1c69-1ba5-48df-83d4-cf533fedae80 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae731332a684481bef208fe5bfc4866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee0e621e3c34c3bba8434228c575a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:43.889363 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-998c1c69-1ba5-48df-83d4-cf533fedae80 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 200 len: 1568 microversion: 2.1 time: 0.234413 May 16 17:46:43.890091 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 363/749] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:46:43 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:46:44.131665 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ed43ca95-9803-408e-a92a-9f268447113a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:44.132617 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ed43ca95-9803-408e-a92a-9f268447113a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:44.145569 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ed43ca95-9803-408e-a92a-9f268447113a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:44.146407 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ed43ca95-9803-408e-a92a-9f268447113a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:44.147573 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ed43ca95-9803-408e-a92a-9f268447113a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:44.148312 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ed43ca95-9803-408e-a92a-9f268447113a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:44.201987 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-941f9b47-6a70-43c2-b978-ddafca4da2a1 req-1488ce54-77d8-4524-9443-fa0d155056ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "643ca394-14c0-407b-be2a-3616138ebdb6", "name": "network-vif-deleted", "tag": "d3d402b3-9560-4542-9028-c21ffae8c316"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:46:44.214746 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-941f9b47-6a70-43c2-b978-ddafca4da2a1 req-1488ce54-77d8-4524-9443-fa0d155056ab service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:44.215196 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-941f9b47-6a70-43c2-b978-ddafca4da2a1 req-1488ce54-77d8-4524-9443-fa0d155056ab service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:44.230011 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-941f9b47-6a70-43c2-b978-ddafca4da2a1 req-1488ce54-77d8-4524-9443-fa0d155056ab service nova] Creating event network-vif-deleted:d3d402b3-9560-4542-9028-c21ffae8c316 for instance 643ca394-14c0-407b-be2a-3616138ebdb6 on hv-cinder-83769 May 16 17:46:44.235468 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-941f9b47-6a70-43c2-b978-ddafca4da2a1 req-1488ce54-77d8-4524-9443-fa0d155056ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038011 May 16 17:46:44.236444 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 364/750] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:46:44.303634 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ed43ca95-9803-408e-a92a-9f268447113a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:44.315713 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ed43ca95-9803-408e-a92a-9f268447113a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:44.317232 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ed43ca95-9803-408e-a92a-9f268447113a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:44.323407 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ed43ca95-9803-408e-a92a-9f268447113a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1722 microversion: 2.20 time: 0.197192 May 16 17:46:44.323961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 387/751] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:44 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:44.907565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-5c586265-6703-400e-8bd8-fa483b9d8ce0 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:44.908565 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-5c586265-6703-400e-8bd8-fa483b9d8ce0 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] [instance: 643ca394-14c0-407b-be2a-3616138ebdb6] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:44.917239 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5c586265-6703-400e-8bd8-fa483b9d8ce0 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:44.918181 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5c586265-6703-400e-8bd8-fa483b9d8ce0 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:44.919174 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5c586265-6703-400e-8bd8-fa483b9d8ce0 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:44.919623 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5c586265-6703-400e-8bd8-fa483b9d8ce0 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:44.935916 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-5c586265-6703-400e-8bd8-fa483b9d8ce0 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] HTTP exception thrown: Instance 643ca394-14c0-407b-be2a-3616138ebdb6 could not be found. May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-5c586265-6703-400e-8bd8-fa483b9d8ce0 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Request method failure captured: May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 HTTP/1.1 May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigozI42DmPKH4z46A2I_kHpQyPyWohFTGNw555Gy80WwoUf3NnI1XEw2h1MD9to-3JUQGjBGu6qS4ozuu_4IhBmjQ2cYxt4oaCmaFJgThwLR_zuAz8xStPQawt6DNrZHGlNstIFOyd4yJuRsZowfUOh4LS5I5jITbEY1GE35bmy6aic0 May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 7ee0e621e3c34c3bba8434228c575a84 May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-TestShelveInstance-1525602959 May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:46:44.937984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:46:44.939366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ee0e621e3c34c3bba8434228c575a84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7ee0e621e3c34c3bba8434228c575a84", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7ee0e621e3c34c3bba8434228c575a84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ee0e621e3c34c3bba8434228c575a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:46:44.939366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-TestShelveInstance-1525602959 May 16 17:46:44.939366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 7ee0e621e3c34c3bba8434228c575a84 May 16 17:46:44.939366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-TestShelveInstance-1525602959 May 16 17:46:44.939366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-TestShelveInstance-1525602959-project May 16 17:46:44.939366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:46:44.939366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:46:44.939366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 1ae731332a684481bef208fe5bfc4866 May 16 17:46:44.939366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-TestShelveInstance-1525602959-project May 16 17:46:44.939366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:46:44.939366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance 643ca394-14c0-407b-be2a-3616138ebdb6 could not be found. May 16 17:46:44.939366 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': '643ca394-14c0-407b-be2a-3616138ebdb6'} May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 643ca394-14c0-407b-be2a-3616138ebdb6 could not be found. May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:46:44.940116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:46:44.941285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:46:44.941285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:46:44.941285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:46:44.941285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:46:44.941285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:46:44.941285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:46:44.941285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:46:44.941285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 643ca394-14c0-407b-be2a-3616138ebdb6 could not be found. May 16 17:46:44.941285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:44.941285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:46:44.941285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:44.941285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:46:44.941285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:46:44.941285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:46:44.941285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:46:44.941285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:46:44.941285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 643ca394-14c0-407b-be2a-3616138ebdb6 could not be found. May 16 17:46:44.941285 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:46:44.942379 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-5c586265-6703-400e-8bd8-fa483b9d8ce0 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Returning 404 to user: Instance 643ca394-14c0-407b-be2a-3616138ebdb6 could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:46:44.942379 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-5c586265-6703-400e-8bd8-fa483b9d8ce0 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6" status: 404 len: 111 microversion: 2.1 time: 0.036745 May 16 17:46:44.942379 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 365/752] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:46:44 2022] GET /compute/v2.1/servers/643ca394-14c0-407b-be2a-3616138ebdb6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:46:45.109930 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-c5124ef9-4aa0-43fb-9e51-a83d092c7af9 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] Calling method '.version_select at 0x7f79a4a073a0>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:45.128623 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-c5124ef9-4aa0-43fb-9e51-a83d092c7af9 tempest-TestShelveInstance-1525602959 tempest-TestShelveInstance-1525602959-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-471635196" status: 202 len: 0 microversion: 2.1 time: 0.022555 May 16 17:46:45.129870 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 388/753] 10.222.0.58 () {58 vars in 1250 bytes} [Mon May 16 17:46:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-471635196 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:46:45.341858 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-3169aaed-cb1d-4461-8a54-dc125bb249a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:45.342502 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-3169aaed-cb1d-4461-8a54-dc125bb249a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:45.348410 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3169aaed-cb1d-4461-8a54-dc125bb249a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:45.348878 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3169aaed-cb1d-4461-8a54-dc125bb249a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:45.349642 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3169aaed-cb1d-4461-8a54-dc125bb249a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:45.350046 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3169aaed-cb1d-4461-8a54-dc125bb249a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:45.489701 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-3169aaed-cb1d-4461-8a54-dc125bb249a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:45.497887 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-3169aaed-cb1d-4461-8a54-dc125bb249a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:45.499435 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-3169aaed-cb1d-4461-8a54-dc125bb249a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:45.500586 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-3169aaed-cb1d-4461-8a54-dc125bb249a2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1722 microversion: 2.20 time: 0.162693 May 16 17:46:45.501278 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 366/754] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:45 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:46.519541 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-40bd330d-489e-4469-a601-aafd949d8813 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:46.520120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-40bd330d-489e-4469-a601-aafd949d8813 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:46.526208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-40bd330d-489e-4469-a601-aafd949d8813 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:46.526682 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-40bd330d-489e-4469-a601-aafd949d8813 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:46.527451 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-40bd330d-489e-4469-a601-aafd949d8813 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:46.527870 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-40bd330d-489e-4469-a601-aafd949d8813 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:46.702724 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-40bd330d-489e-4469-a601-aafd949d8813 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:46.713163 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-40bd330d-489e-4469-a601-aafd949d8813 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:46.714923 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-40bd330d-489e-4469-a601-aafd949d8813 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:46.716175 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-40bd330d-489e-4469-a601-aafd949d8813 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1722 microversion: 2.20 time: 0.201215 May 16 17:46:46.716794 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 389/755] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:46 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:46:47.733335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ade3a397-c666-48e6-9627-368de62922a9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:47.734616 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-ade3a397-c666-48e6-9627-368de62922a9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:47.741123 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ade3a397-c666-48e6-9627-368de62922a9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:47.741576 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ade3a397-c666-48e6-9627-368de62922a9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:47.742371 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ade3a397-c666-48e6-9627-368de62922a9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:47.742803 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ade3a397-c666-48e6-9627-368de62922a9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:47.911924 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-ade3a397-c666-48e6-9627-368de62922a9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:47.922314 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-ade3a397-c666-48e6-9627-368de62922a9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:47.924055 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-ade3a397-c666-48e6-9627-368de62922a9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:47.925635 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ade3a397-c666-48e6-9627-368de62922a9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1722 microversion: 2.20 time: 0.196264 May 16 17:46:47.926682 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 367/756] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:47 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:48.948533 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-b1bc7148-0374-4aee-b532-17a58bed9b3c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:48.949790 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b1bc7148-0374-4aee-b532-17a58bed9b3c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:48.956297 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b1bc7148-0374-4aee-b532-17a58bed9b3c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:48.956735 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b1bc7148-0374-4aee-b532-17a58bed9b3c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:48.957681 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b1bc7148-0374-4aee-b532-17a58bed9b3c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:48.958261 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b1bc7148-0374-4aee-b532-17a58bed9b3c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:49.160180 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b1bc7148-0374-4aee-b532-17a58bed9b3c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:49.168781 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b1bc7148-0374-4aee-b532-17a58bed9b3c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:49.170612 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b1bc7148-0374-4aee-b532-17a58bed9b3c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:49.171932 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-b1bc7148-0374-4aee-b532-17a58bed9b3c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1743 microversion: 2.20 time: 0.227420 May 16 17:46:49.172506 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 390/757] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:48 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1743 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:50.190974 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-671434d2-3ac7-43a5-b515-edd19a6d4f4e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:50.191594 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-671434d2-3ac7-43a5-b515-edd19a6d4f4e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:50.202790 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-671434d2-3ac7-43a5-b515-edd19a6d4f4e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:50.204239 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-671434d2-3ac7-43a5-b515-edd19a6d4f4e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:50.208942 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-671434d2-3ac7-43a5-b515-edd19a6d4f4e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:50.209868 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-671434d2-3ac7-43a5-b515-edd19a6d4f4e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:50.475295 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-671434d2-3ac7-43a5-b515-edd19a6d4f4e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:50.488465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-671434d2-3ac7-43a5-b515-edd19a6d4f4e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:50.490626 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-671434d2-3ac7-43a5-b515-edd19a6d4f4e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:50.492119 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-671434d2-3ac7-43a5-b515-edd19a6d4f4e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1743 microversion: 2.20 time: 0.305621 May 16 17:46:50.493204 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 368/758] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:50 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1743 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:51.511867 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-b0e99ef9-cf32-411b-a791-acc588f92829 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:51.515879 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b0e99ef9-cf32-411b-a791-acc588f92829 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:51.526091 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b0e99ef9-cf32-411b-a791-acc588f92829 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:51.526852 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b0e99ef9-cf32-411b-a791-acc588f92829 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:51.527851 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b0e99ef9-cf32-411b-a791-acc588f92829 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:51.528617 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b0e99ef9-cf32-411b-a791-acc588f92829 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:51.856850 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b0e99ef9-cf32-411b-a791-acc588f92829 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:51.872720 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b0e99ef9-cf32-411b-a791-acc588f92829 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:51.874543 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b0e99ef9-cf32-411b-a791-acc588f92829 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:51.877458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-b0e99ef9-cf32-411b-a791-acc588f92829 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1738 microversion: 2.20 time: 0.371326 May 16 17:46:51.881264 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 391/759] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:51 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1738 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:52.449994 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-eed39200-06e7-4e26-8c2b-f784b13e76f4 req-0d957c0b-bd4e-4458-a30f-fad322345697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc200e3-53ea-4163-8472-0a5e8c70f07e", "name": "network-vif-plugged", "status": "completed", "tag": "f96fabff-8023-4c54-9a2c-526c3f834248"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:46:52.466574 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-eed39200-06e7-4e26-8c2b-f784b13e76f4 req-0d957c0b-bd4e-4458-a30f-fad322345697 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:52.467391 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-eed39200-06e7-4e26-8c2b-f784b13e76f4 req-0d957c0b-bd4e-4458-a30f-fad322345697 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:52.496117 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-eed39200-06e7-4e26-8c2b-f784b13e76f4 req-0d957c0b-bd4e-4458-a30f-fad322345697 service nova] Creating event network-vif-plugged:f96fabff-8023-4c54-9a2c-526c3f834248 for instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e on hv-cinder-83769 May 16 17:46:52.508129 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-eed39200-06e7-4e26-8c2b-f784b13e76f4 req-0d957c0b-bd4e-4458-a30f-fad322345697 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062177 May 16 17:46:52.509688 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 369/760] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:46:52.900743 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-da54df1a-063a-407f-9ebf-1d2b5576c095 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:52.901354 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-da54df1a-063a-407f-9ebf-1d2b5576c095 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:52.914512 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-da54df1a-063a-407f-9ebf-1d2b5576c095 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:52.915061 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-da54df1a-063a-407f-9ebf-1d2b5576c095 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:52.915886 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-da54df1a-063a-407f-9ebf-1d2b5576c095 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:52.916314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-da54df1a-063a-407f-9ebf-1d2b5576c095 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:53.105987 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-da54df1a-063a-407f-9ebf-1d2b5576c095 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:53.117460 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-da54df1a-063a-407f-9ebf-1d2b5576c095 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:53.120438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-da54df1a-063a-407f-9ebf-1d2b5576c095 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:53.122103 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-da54df1a-063a-407f-9ebf-1d2b5576c095 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1738 microversion: 2.20 time: 0.225374 May 16 17:46:53.123262 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 392/761] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:52 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:54.142037 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-804cdae5-245e-4a1f-955d-f16a473748ec tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:54.143623 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-804cdae5-245e-4a1f-955d-f16a473748ec tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:54.163746 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-804cdae5-245e-4a1f-955d-f16a473748ec tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:54.164791 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-804cdae5-245e-4a1f-955d-f16a473748ec tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:54.165790 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-804cdae5-245e-4a1f-955d-f16a473748ec tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:54.166383 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-804cdae5-245e-4a1f-955d-f16a473748ec tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:54.335203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-804cdae5-245e-4a1f-955d-f16a473748ec tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:54.348969 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-804cdae5-245e-4a1f-955d-f16a473748ec tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:54.350996 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-804cdae5-245e-4a1f-955d-f16a473748ec tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:54.352422 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-804cdae5-245e-4a1f-955d-f16a473748ec tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1738 microversion: 2.20 time: 0.215201 May 16 17:46:54.359518 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 370/762] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:54 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:55.371200 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e19a6f1a-f93e-4481-a5d8-3f68f961cf9a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:55.372575 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-e19a6f1a-f93e-4481-a5d8-3f68f961cf9a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:55.380199 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e19a6f1a-f93e-4481-a5d8-3f68f961cf9a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:55.381028 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e19a6f1a-f93e-4481-a5d8-3f68f961cf9a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:55.382533 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e19a6f1a-f93e-4481-a5d8-3f68f961cf9a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:55.383220 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e19a6f1a-f93e-4481-a5d8-3f68f961cf9a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:55.547612 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-e19a6f1a-f93e-4481-a5d8-3f68f961cf9a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:55.556642 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-e19a6f1a-f93e-4481-a5d8-3f68f961cf9a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:55.558407 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-e19a6f1a-f93e-4481-a5d8-3f68f961cf9a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:55.559567 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-e19a6f1a-f93e-4481-a5d8-3f68f961cf9a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1738 microversion: 2.20 time: 0.192697 May 16 17:46:55.560184 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 393/763] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:55 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:56.580903 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-06d8dd10-961b-47f5-be2d-53fc4589c381 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:56.582452 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-06d8dd10-961b-47f5-be2d-53fc4589c381 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:56.591262 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-06d8dd10-961b-47f5-be2d-53fc4589c381 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:56.591993 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-06d8dd10-961b-47f5-be2d-53fc4589c381 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:56.596546 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-06d8dd10-961b-47f5-be2d-53fc4589c381 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:56.597242 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-06d8dd10-961b-47f5-be2d-53fc4589c381 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:56.750773 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-06d8dd10-961b-47f5-be2d-53fc4589c381 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:56.759383 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-06d8dd10-961b-47f5-be2d-53fc4589c381 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:56.761265 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-06d8dd10-961b-47f5-be2d-53fc4589c381 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:56.762844 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-06d8dd10-961b-47f5-be2d-53fc4589c381 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1738 microversion: 2.20 time: 0.186462 May 16 17:46:56.774122 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 371/764] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:56 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:57.782046 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-81956813-61f1-4b5f-8ac3-e5764ad9d9d3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:57.783476 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-81956813-61f1-4b5f-8ac3-e5764ad9d9d3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:57.791089 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-81956813-61f1-4b5f-8ac3-e5764ad9d9d3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:57.791816 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-81956813-61f1-4b5f-8ac3-e5764ad9d9d3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:57.792730 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-81956813-61f1-4b5f-8ac3-e5764ad9d9d3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:57.793211 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-81956813-61f1-4b5f-8ac3-e5764ad9d9d3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:57.946700 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-81956813-61f1-4b5f-8ac3-e5764ad9d9d3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:57.965287 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-81956813-61f1-4b5f-8ac3-e5764ad9d9d3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:57.967554 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-81956813-61f1-4b5f-8ac3-e5764ad9d9d3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:57.969072 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-81956813-61f1-4b5f-8ac3-e5764ad9d9d3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1738 microversion: 2.20 time: 0.191449 May 16 17:46:57.969726 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 394/765] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:57 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:46:58.987962 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-18cbafce-c2d4-41f5-a01f-ed097fb95078 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:46:59.004287 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-18cbafce-c2d4-41f5-a01f-ed097fb95078 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:46:59.004287 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-18cbafce-c2d4-41f5-a01f-ed097fb95078 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:59.004287 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-18cbafce-c2d4-41f5-a01f-ed097fb95078 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:59.004287 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-18cbafce-c2d4-41f5-a01f-ed097fb95078 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:46:59.004726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-18cbafce-c2d4-41f5-a01f-ed097fb95078 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:46:59.154124 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-18cbafce-c2d4-41f5-a01f-ed097fb95078 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:59.163570 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-18cbafce-c2d4-41f5-a01f-ed097fb95078 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:59.166191 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-18cbafce-c2d4-41f5-a01f-ed097fb95078 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:46:59.167476 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-18cbafce-c2d4-41f5-a01f-ed097fb95078 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1738 microversion: 2.20 time: 0.183910 May 16 17:46:59.181644 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 372/766] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:46:58 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:00.189523 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-6cbc8c5e-3567-4c62-87ee-59ce82277f90 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:00.190180 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-6cbc8c5e-3567-4c62-87ee-59ce82277f90 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:00.197625 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6cbc8c5e-3567-4c62-87ee-59ce82277f90 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:00.198088 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6cbc8c5e-3567-4c62-87ee-59ce82277f90 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:00.198913 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6cbc8c5e-3567-4c62-87ee-59ce82277f90 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:00.199352 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6cbc8c5e-3567-4c62-87ee-59ce82277f90 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:00.365745 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-6cbc8c5e-3567-4c62-87ee-59ce82277f90 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:00.373953 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-6cbc8c5e-3567-4c62-87ee-59ce82277f90 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:00.375544 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-6cbc8c5e-3567-4c62-87ee-59ce82277f90 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:00.376797 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-6cbc8c5e-3567-4c62-87ee-59ce82277f90 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1738 microversion: 2.20 time: 0.191657 May 16 17:47:00.387436 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 395/767] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:00 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:01.395704 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d85c4543-f65e-4e9d-b8e7-e1abfc05c7a5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:01.396351 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d85c4543-f65e-4e9d-b8e7-e1abfc05c7a5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:01.403005 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d85c4543-f65e-4e9d-b8e7-e1abfc05c7a5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:01.403460 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d85c4543-f65e-4e9d-b8e7-e1abfc05c7a5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:01.404233 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d85c4543-f65e-4e9d-b8e7-e1abfc05c7a5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:01.404769 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d85c4543-f65e-4e9d-b8e7-e1abfc05c7a5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:01.543532 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d85c4543-f65e-4e9d-b8e7-e1abfc05c7a5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:01.552231 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d85c4543-f65e-4e9d-b8e7-e1abfc05c7a5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:01.553780 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d85c4543-f65e-4e9d-b8e7-e1abfc05c7a5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:01.554970 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d85c4543-f65e-4e9d-b8e7-e1abfc05c7a5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1738 microversion: 2.20 time: 0.163949 May 16 17:47:01.555865 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 373/768] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:01 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:02.577106 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-fa776fd2-552a-4882-a6e8-ea5b00932b1a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:02.577487 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-fa776fd2-552a-4882-a6e8-ea5b00932b1a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:02.585453 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fa776fd2-552a-4882-a6e8-ea5b00932b1a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:02.585453 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fa776fd2-552a-4882-a6e8-ea5b00932b1a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:02.585453 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fa776fd2-552a-4882-a6e8-ea5b00932b1a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:02.585794 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fa776fd2-552a-4882-a6e8-ea5b00932b1a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:02.715974 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-fa776fd2-552a-4882-a6e8-ea5b00932b1a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:02.724389 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-fa776fd2-552a-4882-a6e8-ea5b00932b1a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:02.725903 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-fa776fd2-552a-4882-a6e8-ea5b00932b1a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:02.727063 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-fa776fd2-552a-4882-a6e8-ea5b00932b1a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1720 microversion: 2.20 time: 0.157207 May 16 17:47:02.727632 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 396/769] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:02 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:03.749210 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9df2e96c-846e-4da1-bce1-9d7f0c21e3b0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:03.750064 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-9df2e96c-846e-4da1-bce1-9d7f0c21e3b0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:03.758859 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9df2e96c-846e-4da1-bce1-9d7f0c21e3b0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:03.759451 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9df2e96c-846e-4da1-bce1-9d7f0c21e3b0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:03.760438 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9df2e96c-846e-4da1-bce1-9d7f0c21e3b0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:03.761008 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9df2e96c-846e-4da1-bce1-9d7f0c21e3b0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:03.898610 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9df2e96c-846e-4da1-bce1-9d7f0c21e3b0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:03.906667 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9df2e96c-846e-4da1-bce1-9d7f0c21e3b0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:03.908142 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9df2e96c-846e-4da1-bce1-9d7f0c21e3b0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:03.909324 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-9df2e96c-846e-4da1-bce1-9d7f0c21e3b0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1720 microversion: 2.20 time: 0.166751 May 16 17:47:03.917729 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 374/770] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:03 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:03.936572 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-8877c8bd-47f3-48b8-a1e7-6094c6bfc81d req-d2cf8d4b-9495-481c-96a4-d60ec6eed261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc200e3-53ea-4163-8472-0a5e8c70f07e", "name": "network-vif-unplugged", "status": "completed", "tag": "f96fabff-8023-4c54-9a2c-526c3f834248"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:47:03.946727 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-8877c8bd-47f3-48b8-a1e7-6094c6bfc81d req-d2cf8d4b-9495-481c-96a4-d60ec6eed261 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:03.947180 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-8877c8bd-47f3-48b8-a1e7-6094c6bfc81d req-d2cf8d4b-9495-481c-96a4-d60ec6eed261 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:03.970547 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-8877c8bd-47f3-48b8-a1e7-6094c6bfc81d req-d2cf8d4b-9495-481c-96a4-d60ec6eed261 service nova] Creating event network-vif-unplugged:f96fabff-8023-4c54-9a2c-526c3f834248 for instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e on hv-cinder-83769 May 16 17:47:03.976657 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-8877c8bd-47f3-48b8-a1e7-6094c6bfc81d req-d2cf8d4b-9495-481c-96a4-d60ec6eed261 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043686 May 16 17:47:03.977392 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 397/771] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:47:04.928399 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-16338846-991a-4d9a-91cb-dca9126271ce tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:04.928999 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-16338846-991a-4d9a-91cb-dca9126271ce tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:04.935951 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-16338846-991a-4d9a-91cb-dca9126271ce tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:04.936398 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-16338846-991a-4d9a-91cb-dca9126271ce tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:04.937161 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-16338846-991a-4d9a-91cb-dca9126271ce tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:04.937588 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-16338846-991a-4d9a-91cb-dca9126271ce tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:05.081364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-16338846-991a-4d9a-91cb-dca9126271ce tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:05.089347 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-16338846-991a-4d9a-91cb-dca9126271ce tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:05.090863 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-16338846-991a-4d9a-91cb-dca9126271ce tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:05.092016 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-16338846-991a-4d9a-91cb-dca9126271ce tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1663 microversion: 2.20 time: 0.167713 May 16 17:47:05.092544 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 375/772] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:04 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1663 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:05.111238 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-7cd1d4aa-3178-4f2c-bcb3-fa73b68d2d4b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2029c8b6-d437-426a-8afc-0b05ad520067"}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:47:05.112520 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-7cd1d4aa-3178-4f2c-bcb3-fa73b68d2d4b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:05.119312 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7cd1d4aa-3178-4f2c-bcb3-fa73b68d2d4b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:05.119788 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7cd1d4aa-3178-4f2c-bcb3-fa73b68d2d4b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:05.120546 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7cd1d4aa-3178-4f2c-bcb3-fa73b68d2d4b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:05.120983 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7cd1d4aa-3178-4f2c-bcb3-fa73b68d2d4b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:05.416290 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-7cd1d4aa-3178-4f2c-bcb3-fa73b68d2d4b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "POST /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.310024 May 16 17:47:05.417135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 398/773] 10.222.0.58 () {62 vars in 1363 bytes} [Mon May 16 17:47:05 2022] POST /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e/os-volume_attachments => generated 188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:47:05.527979 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b6283724-57d0-4759-a33b-842f68855d1e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:47:05.528604 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b6283724-57d0-4759-a33b-842f68855d1e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:05.536156 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b6283724-57d0-4759-a33b-842f68855d1e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:05.536869 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b6283724-57d0-4759-a33b-842f68855d1e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:05.537666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b6283724-57d0-4759-a33b-842f68855d1e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:05.538105 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b6283724-57d0-4759-a33b-842f68855d1e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:05.632501 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b6283724-57d0-4759-a33b-842f68855d1e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "POST /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e/action" status: 202 len: 0 microversion: 2.20 time: 0.108518 May 16 17:47:05.633315 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 376/774] 10.222.0.58 () {62 vars in 1318 bytes} [Mon May 16 17:47:05 2022] POST /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 17:47:05.641576 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-29a18172-6f1e-4856-84dd-fe03c3854fc3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:05.642164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-29a18172-6f1e-4856-84dd-fe03c3854fc3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:05.648719 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-29a18172-6f1e-4856-84dd-fe03c3854fc3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:05.649169 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-29a18172-6f1e-4856-84dd-fe03c3854fc3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:05.649950 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-29a18172-6f1e-4856-84dd-fe03c3854fc3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:05.650628 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-29a18172-6f1e-4856-84dd-fe03c3854fc3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:05.798250 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-29a18172-6f1e-4856-84dd-fe03c3854fc3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:05.807948 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-29a18172-6f1e-4856-84dd-fe03c3854fc3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:05.808975 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-29a18172-6f1e-4856-84dd-fe03c3854fc3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:05.810186 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-29a18172-6f1e-4856-84dd-fe03c3854fc3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1749 microversion: 2.20 time: 0.172706 May 16 17:47:05.810933 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 399/775] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:05 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1749 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:47:06.828720 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-55962c2a-d9c4-47bd-8b10-154a726809c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:06.829287 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-55962c2a-d9c4-47bd-8b10-154a726809c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:06.836257 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-55962c2a-d9c4-47bd-8b10-154a726809c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:06.836761 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-55962c2a-d9c4-47bd-8b10-154a726809c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:06.837525 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-55962c2a-d9c4-47bd-8b10-154a726809c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:06.837993 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-55962c2a-d9c4-47bd-8b10-154a726809c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:06.975370 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-55962c2a-d9c4-47bd-8b10-154a726809c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:06.983631 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-55962c2a-d9c4-47bd-8b10-154a726809c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:06.985237 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-55962c2a-d9c4-47bd-8b10-154a726809c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:06.986416 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-55962c2a-d9c4-47bd-8b10-154a726809c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1751 microversion: 2.20 time: 0.161744 May 16 17:47:06.986979 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 377/776] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:06 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:08.005620 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-80a438bb-47eb-43d0-95c2-bda1c97ff035 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:08.006358 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-80a438bb-47eb-43d0-95c2-bda1c97ff035 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:08.013034 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-80a438bb-47eb-43d0-95c2-bda1c97ff035 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:08.013650 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-80a438bb-47eb-43d0-95c2-bda1c97ff035 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:08.014518 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-80a438bb-47eb-43d0-95c2-bda1c97ff035 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:08.015043 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-80a438bb-47eb-43d0-95c2-bda1c97ff035 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:08.162681 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-80a438bb-47eb-43d0-95c2-bda1c97ff035 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:08.171626 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-80a438bb-47eb-43d0-95c2-bda1c97ff035 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:08.173191 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-80a438bb-47eb-43d0-95c2-bda1c97ff035 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:08.174508 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-80a438bb-47eb-43d0-95c2-bda1c97ff035 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.173723 May 16 17:47:08.175109 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 400/777] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:07 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:09.194873 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9a82a1cd-4a72-4a70-91b4-a1a6977df9c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:09.196574 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-9a82a1cd-4a72-4a70-91b4-a1a6977df9c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:09.214597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9a82a1cd-4a72-4a70-91b4-a1a6977df9c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:09.215744 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9a82a1cd-4a72-4a70-91b4-a1a6977df9c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:09.220886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9a82a1cd-4a72-4a70-91b4-a1a6977df9c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:09.222968 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9a82a1cd-4a72-4a70-91b4-a1a6977df9c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:09.369019 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9a82a1cd-4a72-4a70-91b4-a1a6977df9c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:09.379469 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9a82a1cd-4a72-4a70-91b4-a1a6977df9c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:09.381624 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9a82a1cd-4a72-4a70-91b4-a1a6977df9c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:09.383188 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-9a82a1cd-4a72-4a70-91b4-a1a6977df9c4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.193960 May 16 17:47:09.383860 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 378/778] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:09 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:10.402183 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-db0c2e31-385a-48e2-948d-5cf7b1fd3724 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:10.403481 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-db0c2e31-385a-48e2-948d-5cf7b1fd3724 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:10.410229 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-db0c2e31-385a-48e2-948d-5cf7b1fd3724 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:10.410671 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-db0c2e31-385a-48e2-948d-5cf7b1fd3724 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:10.411427 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-db0c2e31-385a-48e2-948d-5cf7b1fd3724 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:10.412038 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-db0c2e31-385a-48e2-948d-5cf7b1fd3724 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:10.552738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-db0c2e31-385a-48e2-948d-5cf7b1fd3724 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:10.562982 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-db0c2e31-385a-48e2-948d-5cf7b1fd3724 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:10.564744 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-db0c2e31-385a-48e2-948d-5cf7b1fd3724 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:10.566072 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-db0c2e31-385a-48e2-948d-5cf7b1fd3724 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.168004 May 16 17:47:10.566837 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 401/779] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:10 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:11.585686 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-6cede0fc-f0d9-45c2-8983-6fe435b44ebd tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:11.586299 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-6cede0fc-f0d9-45c2-8983-6fe435b44ebd tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:11.593358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6cede0fc-f0d9-45c2-8983-6fe435b44ebd tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:11.594270 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6cede0fc-f0d9-45c2-8983-6fe435b44ebd tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:11.595373 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6cede0fc-f0d9-45c2-8983-6fe435b44ebd tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:11.596035 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6cede0fc-f0d9-45c2-8983-6fe435b44ebd tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:11.810065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-6cede0fc-f0d9-45c2-8983-6fe435b44ebd tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:11.831013 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-6cede0fc-f0d9-45c2-8983-6fe435b44ebd tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:11.832538 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-6cede0fc-f0d9-45c2-8983-6fe435b44ebd tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:11.833727 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-6cede0fc-f0d9-45c2-8983-6fe435b44ebd tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.252752 May 16 17:47:11.839494 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 379/780] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:11 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:12.852628 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e7726a0a-83ed-48bc-9487-e6fa69137383 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:12.853183 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-e7726a0a-83ed-48bc-9487-e6fa69137383 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:12.859704 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e7726a0a-83ed-48bc-9487-e6fa69137383 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:12.860397 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e7726a0a-83ed-48bc-9487-e6fa69137383 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:12.861354 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e7726a0a-83ed-48bc-9487-e6fa69137383 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:12.861964 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e7726a0a-83ed-48bc-9487-e6fa69137383 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:13.061454 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-e7726a0a-83ed-48bc-9487-e6fa69137383 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:13.074985 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-e7726a0a-83ed-48bc-9487-e6fa69137383 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:13.076951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-e7726a0a-83ed-48bc-9487-e6fa69137383 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:13.078648 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-e7726a0a-83ed-48bc-9487-e6fa69137383 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.230035 May 16 17:47:13.079877 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 402/781] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:12 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:14.097000 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-2df8818e-285f-4130-8d71-e2a92f725e3b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:14.098478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-2df8818e-285f-4130-8d71-e2a92f725e3b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:14.105748 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2df8818e-285f-4130-8d71-e2a92f725e3b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:14.106352 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2df8818e-285f-4130-8d71-e2a92f725e3b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:14.107186 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2df8818e-285f-4130-8d71-e2a92f725e3b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:14.107615 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2df8818e-285f-4130-8d71-e2a92f725e3b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:14.269037 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-2df8818e-285f-4130-8d71-e2a92f725e3b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:14.281960 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-2df8818e-285f-4130-8d71-e2a92f725e3b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:14.283967 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-2df8818e-285f-4130-8d71-e2a92f725e3b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:14.285162 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-2df8818e-285f-4130-8d71-e2a92f725e3b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.192381 May 16 17:47:14.293961 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 380/782] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:14 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:47:15.304054 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-c8e15093-4f49-4ee5-bff2-e9822616ccfc tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:15.304719 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-c8e15093-4f49-4ee5-bff2-e9822616ccfc tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:15.312168 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c8e15093-4f49-4ee5-bff2-e9822616ccfc tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:15.312609 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c8e15093-4f49-4ee5-bff2-e9822616ccfc tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:15.313452 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c8e15093-4f49-4ee5-bff2-e9822616ccfc tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:15.313921 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c8e15093-4f49-4ee5-bff2-e9822616ccfc tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:15.455439 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-c8e15093-4f49-4ee5-bff2-e9822616ccfc tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:15.464387 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-c8e15093-4f49-4ee5-bff2-e9822616ccfc tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:15.466455 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-c8e15093-4f49-4ee5-bff2-e9822616ccfc tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:15.468016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-c8e15093-4f49-4ee5-bff2-e9822616ccfc tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.168114 May 16 17:47:15.468972 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 403/783] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:15 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:16.489213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-82bff82e-2770-4aa3-a752-332c462b0192 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:16.489836 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-82bff82e-2770-4aa3-a752-332c462b0192 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:16.498759 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-82bff82e-2770-4aa3-a752-332c462b0192 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:16.499246 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-82bff82e-2770-4aa3-a752-332c462b0192 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:16.500121 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-82bff82e-2770-4aa3-a752-332c462b0192 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:16.500574 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-82bff82e-2770-4aa3-a752-332c462b0192 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:16.635509 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-82bff82e-2770-4aa3-a752-332c462b0192 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:16.644801 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-82bff82e-2770-4aa3-a752-332c462b0192 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:16.646381 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-82bff82e-2770-4aa3-a752-332c462b0192 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:16.647571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-82bff82e-2770-4aa3-a752-332c462b0192 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.165000 May 16 17:47:16.648146 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 381/784] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:16 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:17.670931 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-3cbfe8ed-fffe-431b-a5f5-84012e4ce443 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:17.671952 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-3cbfe8ed-fffe-431b-a5f5-84012e4ce443 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:17.678754 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3cbfe8ed-fffe-431b-a5f5-84012e4ce443 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:17.679199 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3cbfe8ed-fffe-431b-a5f5-84012e4ce443 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:17.679964 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3cbfe8ed-fffe-431b-a5f5-84012e4ce443 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:17.680390 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3cbfe8ed-fffe-431b-a5f5-84012e4ce443 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:17.824058 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3cbfe8ed-fffe-431b-a5f5-84012e4ce443 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:17.837833 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3cbfe8ed-fffe-431b-a5f5-84012e4ce443 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:17.840179 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3cbfe8ed-fffe-431b-a5f5-84012e4ce443 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:17.841994 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-3cbfe8ed-fffe-431b-a5f5-84012e4ce443 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.177876 May 16 17:47:17.842803 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 404/785] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:17 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:18.864788 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4ee30c1b-dac8-4c83-b030-a5e81dc19a15 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:18.865807 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4ee30c1b-dac8-4c83-b030-a5e81dc19a15 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:18.876130 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4ee30c1b-dac8-4c83-b030-a5e81dc19a15 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:18.876617 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4ee30c1b-dac8-4c83-b030-a5e81dc19a15 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:18.877357 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4ee30c1b-dac8-4c83-b030-a5e81dc19a15 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:18.877849 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4ee30c1b-dac8-4c83-b030-a5e81dc19a15 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:19.022574 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-4ee30c1b-dac8-4c83-b030-a5e81dc19a15 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:19.034758 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-4ee30c1b-dac8-4c83-b030-a5e81dc19a15 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:19.037048 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-4ee30c1b-dac8-4c83-b030-a5e81dc19a15 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:19.039116 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4ee30c1b-dac8-4c83-b030-a5e81dc19a15 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.180553 May 16 17:47:19.039909 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 382/786] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:18 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:20.064483 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-892a7e84-45e7-4471-99d5-8bb131d5143a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:20.065155 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-892a7e84-45e7-4471-99d5-8bb131d5143a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:20.072848 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-892a7e84-45e7-4471-99d5-8bb131d5143a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:20.073355 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-892a7e84-45e7-4471-99d5-8bb131d5143a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:20.074235 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-892a7e84-45e7-4471-99d5-8bb131d5143a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:20.074723 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-892a7e84-45e7-4471-99d5-8bb131d5143a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:20.215182 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-892a7e84-45e7-4471-99d5-8bb131d5143a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:20.224050 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-892a7e84-45e7-4471-99d5-8bb131d5143a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:20.225584 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-892a7e84-45e7-4471-99d5-8bb131d5143a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:20.226776 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-892a7e84-45e7-4471-99d5-8bb131d5143a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.168074 May 16 17:47:20.227342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 405/787] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:20 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:21.246954 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f1ab6caa-96f2-4a9a-831f-0423de42a8f4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:21.247711 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-f1ab6caa-96f2-4a9a-831f-0423de42a8f4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:21.256034 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f1ab6caa-96f2-4a9a-831f-0423de42a8f4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:21.256584 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f1ab6caa-96f2-4a9a-831f-0423de42a8f4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:21.257531 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f1ab6caa-96f2-4a9a-831f-0423de42a8f4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:21.258101 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f1ab6caa-96f2-4a9a-831f-0423de42a8f4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:21.392643 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f1ab6caa-96f2-4a9a-831f-0423de42a8f4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:21.401065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f1ab6caa-96f2-4a9a-831f-0423de42a8f4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:21.402572 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f1ab6caa-96f2-4a9a-831f-0423de42a8f4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:21.403733 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f1ab6caa-96f2-4a9a-831f-0423de42a8f4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.161814 May 16 17:47:21.404286 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 383/788] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:21 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:22.426526 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-760903e6-d33e-44cc-be54-b0dfc11e39e1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:22.427585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-760903e6-d33e-44cc-be54-b0dfc11e39e1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:22.438120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-760903e6-d33e-44cc-be54-b0dfc11e39e1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:22.438569 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-760903e6-d33e-44cc-be54-b0dfc11e39e1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:22.439326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-760903e6-d33e-44cc-be54-b0dfc11e39e1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:22.439777 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-760903e6-d33e-44cc-be54-b0dfc11e39e1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:22.590176 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-760903e6-d33e-44cc-be54-b0dfc11e39e1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:22.598890 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-760903e6-d33e-44cc-be54-b0dfc11e39e1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:22.600386 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-760903e6-d33e-44cc-be54-b0dfc11e39e1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:22.601571 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-760903e6-d33e-44cc-be54-b0dfc11e39e1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.181715 May 16 17:47:22.602154 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 406/789] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:22 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:23.625230 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-76e7d59d-4394-48d1-a8ab-2dccc253af29 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:23.626486 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-76e7d59d-4394-48d1-a8ab-2dccc253af29 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:23.638478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-76e7d59d-4394-48d1-a8ab-2dccc253af29 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:23.639241 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-76e7d59d-4394-48d1-a8ab-2dccc253af29 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:23.640568 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-76e7d59d-4394-48d1-a8ab-2dccc253af29 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:23.641004 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-76e7d59d-4394-48d1-a8ab-2dccc253af29 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:23.792534 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-76e7d59d-4394-48d1-a8ab-2dccc253af29 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:23.806595 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-76e7d59d-4394-48d1-a8ab-2dccc253af29 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:23.809118 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-76e7d59d-4394-48d1-a8ab-2dccc253af29 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:23.811058 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-76e7d59d-4394-48d1-a8ab-2dccc253af29 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.193248 May 16 17:47:23.811924 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 384/790] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:23 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:24.834093 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-9ff43ea0-3513-4287-a94c-ac28229b9ed6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:24.835072 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-9ff43ea0-3513-4287-a94c-ac28229b9ed6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:24.845097 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9ff43ea0-3513-4287-a94c-ac28229b9ed6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:24.845570 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9ff43ea0-3513-4287-a94c-ac28229b9ed6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:24.846350 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9ff43ea0-3513-4287-a94c-ac28229b9ed6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:24.846791 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9ff43ea0-3513-4287-a94c-ac28229b9ed6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:24.987078 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-9ff43ea0-3513-4287-a94c-ac28229b9ed6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:24.996004 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-9ff43ea0-3513-4287-a94c-ac28229b9ed6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:24.997611 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-9ff43ea0-3513-4287-a94c-ac28229b9ed6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:24.998789 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-9ff43ea0-3513-4287-a94c-ac28229b9ed6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.171399 May 16 17:47:24.999348 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 407/791] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:24 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:26.016985 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f7c0b816-6683-47a9-978b-590a8a7cdfef tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:26.017693 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-f7c0b816-6683-47a9-978b-590a8a7cdfef tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:26.024356 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f7c0b816-6683-47a9-978b-590a8a7cdfef tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:26.024803 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f7c0b816-6683-47a9-978b-590a8a7cdfef tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:26.025592 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f7c0b816-6683-47a9-978b-590a8a7cdfef tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:26.026047 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f7c0b816-6683-47a9-978b-590a8a7cdfef tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:26.161380 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f7c0b816-6683-47a9-978b-590a8a7cdfef tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:26.170616 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f7c0b816-6683-47a9-978b-590a8a7cdfef tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:26.172130 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f7c0b816-6683-47a9-978b-590a8a7cdfef tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:26.173303 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f7c0b816-6683-47a9-978b-590a8a7cdfef tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.160338 May 16 17:47:26.173925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 385/792] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:26 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:27.191975 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-af63e639-5488-4de4-b92f-50d3ff790a10 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:27.192567 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-af63e639-5488-4de4-b92f-50d3ff790a10 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:27.199605 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-af63e639-5488-4de4-b92f-50d3ff790a10 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:27.200048 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-af63e639-5488-4de4-b92f-50d3ff790a10 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:27.200802 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-af63e639-5488-4de4-b92f-50d3ff790a10 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:27.201233 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-af63e639-5488-4de4-b92f-50d3ff790a10 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:27.328083 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-af63e639-5488-4de4-b92f-50d3ff790a10 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:27.336606 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-af63e639-5488-4de4-b92f-50d3ff790a10 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:27.338114 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-af63e639-5488-4de4-b92f-50d3ff790a10 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:27.339252 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-af63e639-5488-4de4-b92f-50d3ff790a10 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.151245 May 16 17:47:27.339814 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 408/793] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:27 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:28.055080 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-bb11ad1d-cfcb-4165-8c18-0f04f1636dc4 req-b83570b5-c043-4924-9c78-914089c19d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc200e3-53ea-4163-8472-0a5e8c70f07e", "name": "network-vif-plugged", "status": "completed", "tag": "f96fabff-8023-4c54-9a2c-526c3f834248"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:47:28.066150 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-bb11ad1d-cfcb-4165-8c18-0f04f1636dc4 req-b83570b5-c043-4924-9c78-914089c19d5b service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:28.067461 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-bb11ad1d-cfcb-4165-8c18-0f04f1636dc4 req-b83570b5-c043-4924-9c78-914089c19d5b service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:28.079200 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-bb11ad1d-cfcb-4165-8c18-0f04f1636dc4 req-b83570b5-c043-4924-9c78-914089c19d5b service nova] Creating event network-vif-plugged:f96fabff-8023-4c54-9a2c-526c3f834248 for instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e on hv-cinder-83769 May 16 17:47:28.084601 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-bb11ad1d-cfcb-4165-8c18-0f04f1636dc4 req-b83570b5-c043-4924-9c78-914089c19d5b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033803 May 16 17:47:28.085487 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 386/794] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:47:28.358241 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-dda34594-69d6-48ea-8c94-67f921208a5b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:28.358823 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-dda34594-69d6-48ea-8c94-67f921208a5b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:28.365356 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dda34594-69d6-48ea-8c94-67f921208a5b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:28.365839 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dda34594-69d6-48ea-8c94-67f921208a5b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:28.366604 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dda34594-69d6-48ea-8c94-67f921208a5b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:28.367033 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dda34594-69d6-48ea-8c94-67f921208a5b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:28.512210 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-dda34594-69d6-48ea-8c94-67f921208a5b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:28.520647 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-dda34594-69d6-48ea-8c94-67f921208a5b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:28.522177 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-dda34594-69d6-48ea-8c94-67f921208a5b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:28.523361 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-dda34594-69d6-48ea-8c94-67f921208a5b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.169817 May 16 17:47:28.523936 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 409/795] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:28 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:29.546715 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9094f27d-8ab7-4b5c-af25-45bb24bdd609 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:29.547848 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-9094f27d-8ab7-4b5c-af25-45bb24bdd609 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:29.555498 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9094f27d-8ab7-4b5c-af25-45bb24bdd609 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:29.556144 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9094f27d-8ab7-4b5c-af25-45bb24bdd609 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:29.556952 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9094f27d-8ab7-4b5c-af25-45bb24bdd609 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:29.557407 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9094f27d-8ab7-4b5c-af25-45bb24bdd609 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:29.701404 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9094f27d-8ab7-4b5c-af25-45bb24bdd609 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:29.710406 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9094f27d-8ab7-4b5c-af25-45bb24bdd609 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:29.712064 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9094f27d-8ab7-4b5c-af25-45bb24bdd609 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:29.713303 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-9094f27d-8ab7-4b5c-af25-45bb24bdd609 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.173661 May 16 17:47:29.713900 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 387/796] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:29 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:30.731950 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0c32628b-6a8f-41c5-bc4c-8ef6e98c0b78 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:30.732512 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-0c32628b-6a8f-41c5-bc4c-8ef6e98c0b78 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:30.739222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0c32628b-6a8f-41c5-bc4c-8ef6e98c0b78 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:30.739661 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0c32628b-6a8f-41c5-bc4c-8ef6e98c0b78 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:30.740416 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0c32628b-6a8f-41c5-bc4c-8ef6e98c0b78 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:30.740839 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0c32628b-6a8f-41c5-bc4c-8ef6e98c0b78 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:30.876537 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-0c32628b-6a8f-41c5-bc4c-8ef6e98c0b78 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:30.886089 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-0c32628b-6a8f-41c5-bc4c-8ef6e98c0b78 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:30.887586 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-0c32628b-6a8f-41c5-bc4c-8ef6e98c0b78 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:30.888774 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-0c32628b-6a8f-41c5-bc4c-8ef6e98c0b78 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1807 microversion: 2.20 time: 0.161040 May 16 17:47:30.889496 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 410/797] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:30 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:31.911163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-59245d0e-e8f8-4753-a643-229785570c7a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:47:31.912134 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-59245d0e-e8f8-4753-a643-229785570c7a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:47:31.923456 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-59245d0e-e8f8-4753-a643-229785570c7a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:31.923907 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-59245d0e-e8f8-4753-a643-229785570c7a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:31.924697 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-59245d0e-e8f8-4753-a643-229785570c7a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:47:31.925114 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-59245d0e-e8f8-4753-a643-229785570c7a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:47:32.058303 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-59245d0e-e8f8-4753-a643-229785570c7a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:32.067380 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-59245d0e-e8f8-4753-a643-229785570c7a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:32.068885 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-59245d0e-e8f8-4753-a643-229785570c7a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:47:32.070096 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-59245d0e-e8f8-4753-a643-229785570c7a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1794 microversion: 2.20 time: 0.165659 May 16 17:47:32.070692 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 388/798] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:47:31 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1794 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:47:57.276820 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-efba6ce4-e1cc-4d9d-95de-bdcc05087565 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Action: 'create', calling method: .version_select at 0x7f79a4929550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1341442974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLn/ESW9AjHI3cqmBsU2iIKIdUDhJXV/cvib7rPwc2OaeXisUK2SU0v3zBs2aSW4rItG9G2LpuqGvCQdvei1WeWzfWC407f0PW0/vQcc5Pux8mBoplA/uik9dJwaEVdmw=="}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:47:57.290694 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-efba6ce4-e1cc-4d9d-95de-bdcc05087565 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Getting quotas for project 782ab44dbedd4b94b6c8fb2414a51a79. Resources: {'key_pairs'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:47:57.294532 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-efba6ce4-e1cc-4d9d-95de-bdcc05087565 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Getting quotas for user bb1a88c50d7f46e297e683e6c7ef033e and project 782ab44dbedd4b94b6c8fb2414a51a79. Resources: {'key_pairs'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:47:57.316622 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-efba6ce4-e1cc-4d9d-95de-bdcc05087565 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.209459 May 16 17:47:57.317234 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 411/799] 10.222.0.58 () {60 vars in 1158 bytes} [Mon May 16 17:47:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:48:05.685120 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-66876929-2792-41a8-bab1-58ad263064fc tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:05.686043 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-66876929-2792-41a8-bab1-58ad263064fc tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:05.693232 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-66876929-2792-41a8-bab1-58ad263064fc tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:05.693720 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-66876929-2792-41a8-bab1-58ad263064fc tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:05.694483 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-66876929-2792-41a8-bab1-58ad263064fc tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:05.694912 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-66876929-2792-41a8-bab1-58ad263064fc tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:05.725332 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-66876929-2792-41a8-bab1-58ad263064fc tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e/os-volume_attachments/2029c8b6-d437-426a-8afc-0b05ad520067" status: 200 len: 194 microversion: 2.20 time: 0.047490 May 16 17:48:05.725940 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 389/800] 10.222.0.58 () {60 vars in 1453 bytes} [Mon May 16 17:48:05 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e/os-volume_attachments/2029c8b6-d437-426a-8afc-0b05ad520067 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:48:05.793690 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-741a5f97-bafd-4609-9d24-c519a0755af1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:05.794277 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-741a5f97-bafd-4609-9d24-c519a0755af1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:05.800559 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-741a5f97-bafd-4609-9d24-c519a0755af1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:05.801002 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-741a5f97-bafd-4609-9d24-c519a0755af1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:05.801793 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-741a5f97-bafd-4609-9d24-c519a0755af1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:05.802226 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-741a5f97-bafd-4609-9d24-c519a0755af1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:05.880231 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.objects.instance [None req-741a5f97-bafd-4609-9d24-c519a0755af1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lazy-loading 'services' on Instance uuid 6dc200e3-53ea-4163-8472-0a5e8c70f07e {{(pid=128815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:48:05.957350 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-741a5f97-bafd-4609-9d24-c519a0755af1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e/os-volume_attachments/2029c8b6-d437-426a-8afc-0b05ad520067" status: 202 len: 0 microversion: 2.20 time: 0.168080 May 16 17:48:05.958228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 412/801] 10.222.0.58 () {60 vars in 1456 bytes} [Mon May 16 17:48:05 2022] DELETE /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e/os-volume_attachments/2029c8b6-d437-426a-8afc-0b05ad520067 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 17:48:05.967520 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-1e17976a-768f-44a5-95d6-55be0557f4cf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:05.968489 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-1e17976a-768f-44a5-95d6-55be0557f4cf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:05.974481 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1e17976a-768f-44a5-95d6-55be0557f4cf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:05.975055 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1e17976a-768f-44a5-95d6-55be0557f4cf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:05.975962 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1e17976a-768f-44a5-95d6-55be0557f4cf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:05.976428 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1e17976a-768f-44a5-95d6-55be0557f4cf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:06.006140 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-1e17976a-768f-44a5-95d6-55be0557f4cf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042445 May 16 17:48:06.006706 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 390/802] 10.222.0.58 () {60 vars in 1342 bytes} [Mon May 16 17:48:05 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:48:07.019579 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-fd312deb-ac67-4bbd-bcd7-af8597b25d17 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:07.020630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-fd312deb-ac67-4bbd-bcd7-af8597b25d17 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:07.027324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fd312deb-ac67-4bbd-bcd7-af8597b25d17 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:07.027776 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fd312deb-ac67-4bbd-bcd7-af8597b25d17 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:07.028516 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fd312deb-ac67-4bbd-bcd7-af8597b25d17 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:07.029144 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fd312deb-ac67-4bbd-bcd7-af8597b25d17 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:07.065153 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-fd312deb-ac67-4bbd-bcd7-af8597b25d17 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050449 May 16 17:48:07.065900 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 413/803] 10.222.0.58 () {60 vars in 1342 bytes} [Mon May 16 17:48:07 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:07.126450 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-6263679d-4122-4cdc-9ee6-b7940178442f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:07.127064 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-6263679d-4122-4cdc-9ee6-b7940178442f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:07.134222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6263679d-4122-4cdc-9ee6-b7940178442f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:07.134672 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6263679d-4122-4cdc-9ee6-b7940178442f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:07.135462 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6263679d-4122-4cdc-9ee6-b7940178442f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:07.135878 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6263679d-4122-4cdc-9ee6-b7940178442f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:07.161926 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-6263679d-4122-4cdc-9ee6-b7940178442f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Going to try to terminate instance {{(pid=128816) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:48:07.246222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-6263679d-4122-4cdc-9ee6-b7940178442f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 204 len: 0 microversion: 2.20 time: 0.123677 May 16 17:48:07.246991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 391/804] 10.222.0.58 () {60 vars in 1279 bytes} [Mon May 16 17:48:07 2022] DELETE /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 17:48:07.255506 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-3ef57a26-5ef5-4c25-b674-8ab1fe8ba55f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:07.256115 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-3ef57a26-5ef5-4c25-b674-8ab1fe8ba55f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:07.262058 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3ef57a26-5ef5-4c25-b674-8ab1fe8ba55f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:07.262519 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3ef57a26-5ef5-4c25-b674-8ab1fe8ba55f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:07.263287 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3ef57a26-5ef5-4c25-b674-8ab1fe8ba55f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:07.263723 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3ef57a26-5ef5-4c25-b674-8ab1fe8ba55f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:07.401099 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3ef57a26-5ef5-4c25-b674-8ab1fe8ba55f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:07.410680 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3ef57a26-5ef5-4c25-b674-8ab1fe8ba55f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:07.412165 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3ef57a26-5ef5-4c25-b674-8ab1fe8ba55f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:07.413679 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-3ef57a26-5ef5-4c25-b674-8ab1fe8ba55f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1722 microversion: 2.20 time: 0.162199 May 16 17:48:07.414275 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 414/805] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:48:07 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:48:08.436767 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-83865bd5-4984-4529-b2c1-ae73f2914410 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:08.437948 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-83865bd5-4984-4529-b2c1-ae73f2914410 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:08.448210 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-83865bd5-4984-4529-b2c1-ae73f2914410 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:08.448946 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-83865bd5-4984-4529-b2c1-ae73f2914410 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:08.450232 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-83865bd5-4984-4529-b2c1-ae73f2914410 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:08.450947 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-83865bd5-4984-4529-b2c1-ae73f2914410 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:08.580458 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-83865bd5-4984-4529-b2c1-ae73f2914410 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:08.588376 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-83865bd5-4984-4529-b2c1-ae73f2914410 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:08.589956 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-83865bd5-4984-4529-b2c1-ae73f2914410 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:08.591099 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-83865bd5-4984-4529-b2c1-ae73f2914410 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1722 microversion: 2.20 time: 0.161766 May 16 17:48:08.591910 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 392/806] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:48:08 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:48:09.612881 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-303e70bd-d37f-4a82-aa10-8b32fe2aab80 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:09.614015 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-303e70bd-d37f-4a82-aa10-8b32fe2aab80 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:09.620524 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-303e70bd-d37f-4a82-aa10-8b32fe2aab80 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:09.620945 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-303e70bd-d37f-4a82-aa10-8b32fe2aab80 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:09.622211 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-303e70bd-d37f-4a82-aa10-8b32fe2aab80 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:09.622832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-303e70bd-d37f-4a82-aa10-8b32fe2aab80 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:09.665329 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-d093bdb8-2201-4e0d-be90-d567b77b56c2 req-538b3cdf-4508-4052-b041-1ee86794db39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc200e3-53ea-4163-8472-0a5e8c70f07e", "name": "network-vif-deleted", "tag": "f96fabff-8023-4c54-9a2c-526c3f834248"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:48:09.676876 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-d093bdb8-2201-4e0d-be90-d567b77b56c2 req-538b3cdf-4508-4052-b041-1ee86794db39 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:09.680138 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-d093bdb8-2201-4e0d-be90-d567b77b56c2 req-538b3cdf-4508-4052-b041-1ee86794db39 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:09.692393 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-d093bdb8-2201-4e0d-be90-d567b77b56c2 req-538b3cdf-4508-4052-b041-1ee86794db39 service nova] Creating event network-vif-deleted:f96fabff-8023-4c54-9a2c-526c3f834248 for instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e on hv-cinder-83769 May 16 17:48:09.692963 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-303e70bd-d37f-4a82-aa10-8b32fe2aab80 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:09.697530 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-d093bdb8-2201-4e0d-be90-d567b77b56c2 req-538b3cdf-4508-4052-b041-1ee86794db39 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036093 May 16 17:48:09.699220 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 393/807] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:48:09.702442 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-303e70bd-d37f-4a82-aa10-8b32fe2aab80 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:09.704255 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-303e70bd-d37f-4a82-aa10-8b32fe2aab80 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:09.716657 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-303e70bd-d37f-4a82-aa10-8b32fe2aab80 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 200 len: 1655 microversion: 2.20 time: 0.107448 May 16 17:48:09.719007 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 415/808] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:48:09 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 1655 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:48:10.738999 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4223f620-ebbb-4aae-ba92-29764533d2d4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:10.739604 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4223f620-ebbb-4aae-ba92-29764533d2d4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:10.746290 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4223f620-ebbb-4aae-ba92-29764533d2d4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:10.746737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4223f620-ebbb-4aae-ba92-29764533d2d4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:10.747498 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4223f620-ebbb-4aae-ba92-29764533d2d4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:10.747928 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4223f620-ebbb-4aae-ba92-29764533d2d4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:10.761066 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-4223f620-ebbb-4aae-ba92-29764533d2d4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] HTTP exception thrown: Instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e could not be found. May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4223f620-ebbb-4aae-ba92-29764533d2d4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Request method failure captured: May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e HTTP/1.1 May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigo3Bgf2DaHqLnAhXH8JGptB3QGFYfmrdCuGd8A27MytEun23d7VVPf3JJRUJvUv1GEV3-meqp17DpZGEi5ZM8ujMcljqrLw9zS7Fkods3zs6Y9IYWksEDbG-JhaCclRzWM2bg5MLBPzyHbWF3H6cMlmK8N2IXl0MJJNoJgbPCrqjML8 May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Openstack-Nova-Api-Version: 2.20 May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 8b218f6b53844d828be7b8c5de1cde67 May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1201041881 May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:48:10.762694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:48:10.764302 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b218f6b53844d828be7b8c5de1cde67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8b218f6b53844d828be7b8c5de1cde67", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8b218f6b53844d828be7b8c5de1cde67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b218f6b53844d828be7b8c5de1cde67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:48:10.764302 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1201041881 May 16 17:48:10.764302 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 8b218f6b53844d828be7b8c5de1cde67 May 16 17:48:10.764302 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1201041881 May 16 17:48:10.764302 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-AttachVolumeShelveTestJSON-1201041881-project May 16 17:48:10.764302 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:48:10.764302 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:48:10.764302 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: e1ddee42951b4de98dea071f2b7a9958 May 16 17:48:10.764302 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1201041881-project May 16 17:48:10.764302 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:48:10.764302 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e could not be found. May 16 17:48:10.764302 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': '6dc200e3-53ea-4163-8472-0a5e8c70f07e'} May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e could not be found. May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:48:10.765106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:48:10.766508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:48:10.766508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:48:10.766508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:48:10.766508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:48:10.766508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:48:10.766508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:48:10.766508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:48:10.766508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e could not be found. May 16 17:48:10.766508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:48:10.766508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:48:10.766508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:48:10.766508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:48:10.766508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:48:10.766508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:48:10.766508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:48:10.766508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:48:10.766508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e could not be found. May 16 17:48:10.766508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:48:10.767655 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4223f620-ebbb-4aae-ba92-29764533d2d4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Returning 404 to user: Instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:48:10.767655 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4223f620-ebbb-4aae-ba92-29764533d2d4 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 404 len: 111 microversion: 2.20 time: 0.029849 May 16 17:48:10.767655 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 394/809] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:48:10 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 17:48:10.773063 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-9c7f1364-6282-448d-bdac-93783336d411 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '.version_select at 0x7f79a486ff70>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:10.792675 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-9c7f1364-6282-448d-bdac-93783336d411 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-984443825" status: 204 len: 0 microversion: 2.20 time: 0.023416 May 16 17:48:10.793205 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 416/810] 10.222.0.58 () {60 vars in 1258 bytes} [Mon May 16 17:48:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-984443825 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 17:48:11.435013 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e507f96b-71e0-4cce-9f72-6f34d33b7655 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Action: 'create', calling method: .version_select at 0x7f79a47693a0>, body: {"keypair": {"name": "tempest-keypair-1892317308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOG/WBBB7eGSU++OlYnBIOOvGNq1kKXKEy7+f38vFcgb2e5EhWwHC/uDvnuMZ+nDiw9dJevZZgZL7UgJ62PtCTkANobJyt94WPkMp20ZEILl8xqbP3tWHmGDsZ1JF/0aQ=="}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:48:11.449478 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-e507f96b-71e0-4cce-9f72-6f34d33b7655 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Getting quotas for project 8b218f6b53844d828be7b8c5de1cde67. Resources: {'key_pairs'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:48:11.453414 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-e507f96b-71e0-4cce-9f72-6f34d33b7655 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Getting quotas for user e1ddee42951b4de98dea071f2b7a9958 and project 8b218f6b53844d828be7b8c5de1cde67. Resources: {'key_pairs'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:48:11.465083 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e507f96b-71e0-4cce-9f72-6f34d33b7655 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [aa5d3593-8e29-496f-b8dd-eca810332fc4] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 16 17:48:12.473814 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO oslo.messaging._drivers.impl_rabbit [None req-e507f96b-71e0-4cce-9f72-6f34d33b7655 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [aa5d3593-8e29-496f-b8dd-eca810332fc4] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 59416. May 16 17:48:12.489312 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e507f96b-71e0-4cce-9f72-6f34d33b7655 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.058055 May 16 17:48:12.489977 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 395/811] 10.222.0.58 () {62 vars in 1199 bytes} [Mon May 16 17:48:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1059 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 16 17:48:13.644429 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-19e3c2bb-db8b-4066-ac77-43c359b87c30 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-610489504", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1341442974", "security_groups": [{"name": "tempest-secgroup-smoke-941768447"}], "block_device_mapping_v2": [{"uuid": "de25aaa8-a327-4251-9c6f-a49d7b7dbdc5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "20304413-223e-468b-b381-be0770314d15"}]}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:48:13.778124 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.network.neutron [None req-19e3c2bb-db8b-4066-ac77-43c359b87c30 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] validate_networks() for [('20304413-223e-468b-b381-be0770314d15', None, None, None, None, None)] {{(pid=128815) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:48:13.878163 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e6871bed-f303-45a1-962b-72595a1d51ea tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-623893968", "imageRef": "782bd628-ef1b-419c-99f5-2c312d1766a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0229cc9-7da5-499c-a6ca-89f02d2e0332"}], "security_groups": [{"name": "tempest-securitygroup--2076173315"}], "key_name": "tempest-keypair-1892317308", "user_data": "}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:48:14.020011 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.network.neutron [None req-e6871bed-f303-45a1-962b-72595a1d51ea tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] validate_networks() for [('e0229cc9-7da5-499c-a6ca-89f02d2e0332', None, None, None, None, None)] {{(pid=128816) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:48:14.289578 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-19e3c2bb-db8b-4066-ac77-43c359b87c30 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Flavor limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:48:14.290026 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-19e3c2bb-db8b-4066-ac77-43c359b87c30 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Image limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:48:14.290496 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-19e3c2bb-db8b-4066-ac77-43c359b87c30 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Flavor pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:48:14.290902 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-19e3c2bb-db8b-4066-ac77-43c359b87c30 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Image pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:48:14.291311 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-19e3c2bb-db8b-4066-ac77-43c359b87c30 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:48:14.302346 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-19e3c2bb-db8b-4066-ac77-43c359b87c30 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:14.302905 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-19e3c2bb-db8b-4066-ac77-43c359b87c30 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:14.304368 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-19e3c2bb-db8b-4066-ac77-43c359b87c30 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:14.305001 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-19e3c2bb-db8b-4066-ac77-43c359b87c30 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:14.322682 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-19e3c2bb-db8b-4066-ac77-43c359b87c30 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Getting quotas for project 782ab44dbedd4b94b6c8fb2414a51a79. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:48:14.326747 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-19e3c2bb-db8b-4066-ac77-43c359b87c30 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Getting quotas for user bb1a88c50d7f46e297e683e6c7ef033e and project 782ab44dbedd4b94b6c8fb2414a51a79. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:48:14.383038 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-19e3c2bb-db8b-4066-ac77-43c359b87c30 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Going to run 1 instances... {{(pid=128815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:48:14.385182 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-19e3c2bb-db8b-4066-ac77-43c359b87c30 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de25aaa8-a327-4251-9c6f-a49d7b7dbdc5',volume_size=None,volume_type=None)] {{(pid=128815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:48:14.503135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-e6871bed-f303-45a1-962b-72595a1d51ea tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Flavor limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:48:14.503562 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-e6871bed-f303-45a1-962b-72595a1d51ea tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Image limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:48:14.504032 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-e6871bed-f303-45a1-962b-72595a1d51ea tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Flavor pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:48:14.504438 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-e6871bed-f303-45a1-962b-72595a1d51ea tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Image pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:48:14.504847 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-e6871bed-f303-45a1-962b-72595a1d51ea tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:48:14.514813 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e6871bed-f303-45a1-962b-72595a1d51ea tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:14.515262 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e6871bed-f303-45a1-962b-72595a1d51ea tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:14.516229 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e6871bed-f303-45a1-962b-72595a1d51ea tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:14.516664 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e6871bed-f303-45a1-962b-72595a1d51ea tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:14.517567 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR oslo.messaging._drivers.impl_rabbit [None req-19e3c2bb-db8b-4066-ac77-43c359b87c30 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [d0110717-8021-4947-ab02-71f91eb2d505] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 16 17:48:14.532934 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-e6871bed-f303-45a1-962b-72595a1d51ea tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Getting quotas for project 8b218f6b53844d828be7b8c5de1cde67. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:48:14.536835 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-e6871bed-f303-45a1-962b-72595a1d51ea tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Getting quotas for user e1ddee42951b4de98dea071f2b7a9958 and project 8b218f6b53844d828be7b8c5de1cde67. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:48:14.548001 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e6871bed-f303-45a1-962b-72595a1d51ea tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Going to run 1 instances... {{(pid=128816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:48:14.550327 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e6871bed-f303-45a1-962b-72595a1d51ea tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='782bd628-ef1b-419c-99f5-2c312d1766a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:48:14.600711 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e6871bed-f303-45a1-962b-72595a1d51ea tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.727114 May 16 17:48:14.602271 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 396/812] 10.222.0.58 () {62 vars in 1187 bytes} [Mon May 16 17:48:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 16 17:48:14.612289 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-1f9be0ba-6df9-4375-ab3a-56aeb0d430d1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:14.612987 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-1f9be0ba-6df9-4375-ab3a-56aeb0d430d1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:14.668707 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-1f9be0ba-6df9-4375-ab3a-56aeb0d430d1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:14.676299 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-1f9be0ba-6df9-4375-ab3a-56aeb0d430d1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:14.677784 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-1f9be0ba-6df9-4375-ab3a-56aeb0d430d1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:14.678896 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-1f9be0ba-6df9-4375-ab3a-56aeb0d430d1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1281 microversion: 2.20 time: 0.070458 May 16 17:48:14.679456 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 397/813] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:48:14 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:48:15.525805 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO oslo.messaging._drivers.impl_rabbit [None req-19e3c2bb-db8b-4066-ac77-43c359b87c30 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [d0110717-8021-4947-ab02-71f91eb2d505] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 59456. May 16 17:48:15.530146 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-19e3c2bb-db8b-4066-ac77-43c359b87c30 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.890468 May 16 17:48:15.530788 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 417/814] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:48:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:48:15.541164 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d49e58c7-b879-40e3-9ca5-73d1d4ec863d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:15.541806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d49e58c7-b879-40e3-9ca5-73d1d4ec863d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:15.600062 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d49e58c7-b879-40e3-9ca5-73d1d4ec863d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:15.607200 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d49e58c7-b879-40e3-9ca5-73d1d4ec863d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1094 microversion: 2.1 time: 0.070066 May 16 17:48:15.607625 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 398/815] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:48:15 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:15.696887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-557f2c71-1b92-41c3-9093-c26b6297ffb3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:15.697509 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-557f2c71-1b92-41c3-9093-c26b6297ffb3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:15.750020 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-557f2c71-1b92-41c3-9093-c26b6297ffb3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:15.757450 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-557f2c71-1b92-41c3-9093-c26b6297ffb3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:15.758989 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-557f2c71-1b92-41c3-9093-c26b6297ffb3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:15.760127 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-557f2c71-1b92-41c3-9093-c26b6297ffb3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1281 microversion: 2.20 time: 0.067683 May 16 17:48:15.760863 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 418/816] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:48:15 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:48:16.632010 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-41704f39-b1e1-43bf-a82c-58fe47344ef7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:16.633093 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-41704f39-b1e1-43bf-a82c-58fe47344ef7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:16.688899 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-41704f39-b1e1-43bf-a82c-58fe47344ef7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:16.695608 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-41704f39-b1e1-43bf-a82c-58fe47344ef7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1094 microversion: 2.1 time: 0.070060 May 16 17:48:16.696160 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 399/817] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:48:16 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:16.777868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-13bc66fe-1cce-4af0-b4e9-9abf1e0fac0b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:16.778497 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-13bc66fe-1cce-4af0-b4e9-9abf1e0fac0b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:16.785698 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-13bc66fe-1cce-4af0-b4e9-9abf1e0fac0b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:16.786147 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-13bc66fe-1cce-4af0-b4e9-9abf1e0fac0b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:16.786917 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-13bc66fe-1cce-4af0-b4e9-9abf1e0fac0b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:16.787354 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-13bc66fe-1cce-4af0-b4e9-9abf1e0fac0b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:16.849593 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-13bc66fe-1cce-4af0-b4e9-9abf1e0fac0b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:16.857731 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-13bc66fe-1cce-4af0-b4e9-9abf1e0fac0b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:16.859277 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-13bc66fe-1cce-4af0-b4e9-9abf1e0fac0b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:16.860381 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-13bc66fe-1cce-4af0-b4e9-9abf1e0fac0b tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1285 microversion: 2.20 time: 0.086492 May 16 17:48:16.860937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 419/818] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:48:16 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:48:17.712760 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b2a985c8-a7d5-4dc1-92f5-31622841f6a5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:17.714329 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b2a985c8-a7d5-4dc1-92f5-31622841f6a5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:17.772531 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-b2a985c8-a7d5-4dc1-92f5-31622841f6a5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:17.779316 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b2a985c8-a7d5-4dc1-92f5-31622841f6a5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1094 microversion: 2.1 time: 0.070686 May 16 17:48:17.779916 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 400/819] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:48:17 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:17.878869 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-7cdf2038-f9ce-4814-bcc9-4a2800f04bbf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:17.879578 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-7cdf2038-f9ce-4814-bcc9-4a2800f04bbf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:17.886497 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7cdf2038-f9ce-4814-bcc9-4a2800f04bbf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:17.887345 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7cdf2038-f9ce-4814-bcc9-4a2800f04bbf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:17.888250 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7cdf2038-f9ce-4814-bcc9-4a2800f04bbf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:17.888899 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7cdf2038-f9ce-4814-bcc9-4a2800f04bbf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:18.120063 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-7cdf2038-f9ce-4814-bcc9-4a2800f04bbf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:18.128978 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-7cdf2038-f9ce-4814-bcc9-4a2800f04bbf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:18.130660 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-7cdf2038-f9ce-4814-bcc9-4a2800f04bbf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:18.132029 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-7cdf2038-f9ce-4814-bcc9-4a2800f04bbf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1339 microversion: 2.20 time: 0.257909 May 16 17:48:18.132621 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 420/820] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:48:17 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1339 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:48:18.797699 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-fe05f137-584c-48ef-99e6-90cdcfe41c6e tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:18.798965 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-fe05f137-584c-48ef-99e6-90cdcfe41c6e tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:18.806382 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fe05f137-584c-48ef-99e6-90cdcfe41c6e tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:18.806908 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fe05f137-584c-48ef-99e6-90cdcfe41c6e tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:18.807831 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fe05f137-584c-48ef-99e6-90cdcfe41c6e tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:18.808332 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fe05f137-584c-48ef-99e6-90cdcfe41c6e tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:18.902057 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-fe05f137-584c-48ef-99e6-90cdcfe41c6e tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:18.913395 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-fe05f137-584c-48ef-99e6-90cdcfe41c6e tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1210 microversion: 2.1 time: 0.119200 May 16 17:48:18.914117 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 401/821] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:48:18 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1210 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:19.152496 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-99a5c78e-79e8-4be5-897b-9a3628db44b8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:19.153814 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-99a5c78e-79e8-4be5-897b-9a3628db44b8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:19.161342 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-99a5c78e-79e8-4be5-897b-9a3628db44b8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:19.162100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-99a5c78e-79e8-4be5-897b-9a3628db44b8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:19.163383 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-99a5c78e-79e8-4be5-897b-9a3628db44b8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:19.163851 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-99a5c78e-79e8-4be5-897b-9a3628db44b8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:19.410326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-99a5c78e-79e8-4be5-897b-9a3628db44b8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:19.426838 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-99a5c78e-79e8-4be5-897b-9a3628db44b8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:19.429879 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-99a5c78e-79e8-4be5-897b-9a3628db44b8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:19.432596 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-99a5c78e-79e8-4be5-897b-9a3628db44b8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1407 microversion: 2.20 time: 0.282935 May 16 17:48:19.434140 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 421/822] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:48:19 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:48:19.567325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-4ab62a51-dadb-4ce7-8880-ec00ee99cf0d req-7aad17b2-e581-4f7a-be6e-444e4f52e881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9d18297-c3bf-4b67-b775-1121be87da07", "tag": "82d9ed45-eecf-4842-8a43-0e5549e8b8a9"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:48:19.600695 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-4ab62a51-dadb-4ce7-8880-ec00ee99cf0d req-7aad17b2-e581-4f7a-be6e-444e4f52e881 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:19.602174 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-4ab62a51-dadb-4ce7-8880-ec00ee99cf0d req-7aad17b2-e581-4f7a-be6e-444e4f52e881 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:19.627145 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-4ab62a51-dadb-4ce7-8880-ec00ee99cf0d req-7aad17b2-e581-4f7a-be6e-444e4f52e881 service nova] Creating event network-changed:82d9ed45-eecf-4842-8a43-0e5549e8b8a9 for instance a9d18297-c3bf-4b67-b775-1121be87da07 on hv-cinder-83769 May 16 17:48:19.635147 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-4ab62a51-dadb-4ce7-8880-ec00ee99cf0d req-7aad17b2-e581-4f7a-be6e-444e4f52e881 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071657 May 16 17:48:19.636346 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 402/823] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:48:19.931357 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d08cd752-d5de-4fa4-8efa-5b05b5365adb tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:19.931921 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d08cd752-d5de-4fa4-8efa-5b05b5365adb tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:19.938150 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d08cd752-d5de-4fa4-8efa-5b05b5365adb tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:19.938679 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d08cd752-d5de-4fa4-8efa-5b05b5365adb tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:19.939562 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d08cd752-d5de-4fa4-8efa-5b05b5365adb tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:19.940178 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d08cd752-d5de-4fa4-8efa-5b05b5365adb tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:20.099016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d08cd752-d5de-4fa4-8efa-5b05b5365adb tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:20.107936 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d08cd752-d5de-4fa4-8efa-5b05b5365adb tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1265 microversion: 2.1 time: 0.180362 May 16 17:48:20.115388 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 422/824] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:48:19 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:20.262811 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-9fb3c3f5-ae4f-45b1-8ef9-16618f1dfdb7 req-ea45fda1-e85c-43c2-9ffe-6a4d9164f320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9279a4c5-c764-46b4-8028-3bb0d8de0406", "tag": "59abc649-1713-4a6f-b4af-005a342766ce"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:48:20.272671 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-9fb3c3f5-ae4f-45b1-8ef9-16618f1dfdb7 req-ea45fda1-e85c-43c2-9ffe-6a4d9164f320 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:20.273183 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-9fb3c3f5-ae4f-45b1-8ef9-16618f1dfdb7 req-ea45fda1-e85c-43c2-9ffe-6a4d9164f320 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:20.285061 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-9fb3c3f5-ae4f-45b1-8ef9-16618f1dfdb7 req-ea45fda1-e85c-43c2-9ffe-6a4d9164f320 service nova] Creating event network-changed:59abc649-1713-4a6f-b4af-005a342766ce for instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 on hv-cinder-83769 May 16 17:48:20.289925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-9fb3c3f5-ae4f-45b1-8ef9-16618f1dfdb7 req-ea45fda1-e85c-43c2-9ffe-6a4d9164f320 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032376 May 16 17:48:20.290638 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 403/825] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:48:20.451653 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-10e1a275-f977-4eec-a9c0-1a410122d7c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:20.452403 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-10e1a275-f977-4eec-a9c0-1a410122d7c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:20.458859 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-10e1a275-f977-4eec-a9c0-1a410122d7c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:20.459312 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-10e1a275-f977-4eec-a9c0-1a410122d7c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:20.460069 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-10e1a275-f977-4eec-a9c0-1a410122d7c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:20.460505 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-10e1a275-f977-4eec-a9c0-1a410122d7c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:20.595679 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-10e1a275-f977-4eec-a9c0-1a410122d7c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:20.604106 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-10e1a275-f977-4eec-a9c0-1a410122d7c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:20.605582 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-10e1a275-f977-4eec-a9c0-1a410122d7c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:20.606715 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-10e1a275-f977-4eec-a9c0-1a410122d7c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1407 microversion: 2.20 time: 0.159140 May 16 17:48:20.607285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 423/826] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:48:20 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:48:21.125790 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-572e17ca-c3eb-47f8-8977-f845d4571332 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:21.126533 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-572e17ca-c3eb-47f8-8977-f845d4571332 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:21.132828 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-572e17ca-c3eb-47f8-8977-f845d4571332 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:21.133256 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-572e17ca-c3eb-47f8-8977-f845d4571332 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:21.134095 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-572e17ca-c3eb-47f8-8977-f845d4571332 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:21.134556 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-572e17ca-c3eb-47f8-8977-f845d4571332 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:21.342786 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-572e17ca-c3eb-47f8-8977-f845d4571332 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:21.350816 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-572e17ca-c3eb-47f8-8977-f845d4571332 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1265 microversion: 2.1 time: 0.229272 May 16 17:48:21.351546 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 404/827] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:48:21 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:21.629595 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-6b8b0f81-24e4-42a1-a337-056cdba12e97 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:21.630455 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-6b8b0f81-24e4-42a1-a337-056cdba12e97 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:21.641414 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6b8b0f81-24e4-42a1-a337-056cdba12e97 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:21.642218 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6b8b0f81-24e4-42a1-a337-056cdba12e97 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:21.643489 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6b8b0f81-24e4-42a1-a337-056cdba12e97 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:21.644273 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6b8b0f81-24e4-42a1-a337-056cdba12e97 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:21.786734 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-6b8b0f81-24e4-42a1-a337-056cdba12e97 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:21.799739 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-6b8b0f81-24e4-42a1-a337-056cdba12e97 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:21.802011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-6b8b0f81-24e4-42a1-a337-056cdba12e97 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:21.803710 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-6b8b0f81-24e4-42a1-a337-056cdba12e97 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1407 microversion: 2.20 time: 0.180635 May 16 17:48:21.804519 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 424/828] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:48:21 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:48:22.368688 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9f785b67-cb71-4117-a8b7-7d8433273ef5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:22.369377 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-9f785b67-cb71-4117-a8b7-7d8433273ef5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:22.375985 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9f785b67-cb71-4117-a8b7-7d8433273ef5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:22.376504 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9f785b67-cb71-4117-a8b7-7d8433273ef5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:22.377330 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9f785b67-cb71-4117-a8b7-7d8433273ef5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:22.377849 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9f785b67-cb71-4117-a8b7-7d8433273ef5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:22.509476 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9f785b67-cb71-4117-a8b7-7d8433273ef5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:22.517334 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-9f785b67-cb71-4117-a8b7-7d8433273ef5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1265 microversion: 2.1 time: 0.152606 May 16 17:48:22.517969 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 405/829] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:48:22 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:22.828966 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-a6b8cf0a-79d7-4e04-8423-2ebb940342c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:22.829915 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a6b8cf0a-79d7-4e04-8423-2ebb940342c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:22.840625 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a6b8cf0a-79d7-4e04-8423-2ebb940342c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:22.841313 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a6b8cf0a-79d7-4e04-8423-2ebb940342c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:22.842607 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a6b8cf0a-79d7-4e04-8423-2ebb940342c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:22.843319 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a6b8cf0a-79d7-4e04-8423-2ebb940342c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:22.979717 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-a6b8cf0a-79d7-4e04-8423-2ebb940342c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:22.989001 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-a6b8cf0a-79d7-4e04-8423-2ebb940342c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:22.990528 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-a6b8cf0a-79d7-4e04-8423-2ebb940342c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:22.991619 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-a6b8cf0a-79d7-4e04-8423-2ebb940342c6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1407 microversion: 2.20 time: 0.169334 May 16 17:48:22.992180 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 425/830] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:48:22 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:48:23.533678 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-be7a739b-c7f4-403b-a4bf-c7db378d2758 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:23.534284 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-be7a739b-c7f4-403b-a4bf-c7db378d2758 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:23.541408 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-be7a739b-c7f4-403b-a4bf-c7db378d2758 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:23.541886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-be7a739b-c7f4-403b-a4bf-c7db378d2758 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:23.542648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-be7a739b-c7f4-403b-a4bf-c7db378d2758 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:23.543087 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-be7a739b-c7f4-403b-a4bf-c7db378d2758 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:23.682416 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-be7a739b-c7f4-403b-a4bf-c7db378d2758 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:23.692097 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-be7a739b-c7f4-403b-a4bf-c7db378d2758 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1265 microversion: 2.1 time: 0.162387 May 16 17:48:23.692668 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 406/831] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:48:23 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:24.013591 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-9bda65b4-d820-4b82-b5d2-fc6cccea9719 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:24.014506 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-9bda65b4-d820-4b82-b5d2-fc6cccea9719 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:24.025352 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9bda65b4-d820-4b82-b5d2-fc6cccea9719 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:24.026165 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9bda65b4-d820-4b82-b5d2-fc6cccea9719 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:24.027437 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9bda65b4-d820-4b82-b5d2-fc6cccea9719 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:24.028166 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9bda65b4-d820-4b82-b5d2-fc6cccea9719 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:24.160576 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-9bda65b4-d820-4b82-b5d2-fc6cccea9719 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:24.169162 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-9bda65b4-d820-4b82-b5d2-fc6cccea9719 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:24.170689 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-9bda65b4-d820-4b82-b5d2-fc6cccea9719 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:24.171903 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-9bda65b4-d820-4b82-b5d2-fc6cccea9719 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1407 microversion: 2.20 time: 0.164837 May 16 17:48:24.172460 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 426/832] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:48:24 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:48:24.334099 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-683129e8-cd47-4f15-80ba-acd1385786e9 req-45f8c35a-68ce-45fb-ab12-955b4994d75b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d18297-c3bf-4b67-b775-1121be87da07", "name": "network-vif-plugged", "status": "completed", "tag": "82d9ed45-eecf-4842-8a43-0e5549e8b8a9"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:48:24.342278 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-683129e8-cd47-4f15-80ba-acd1385786e9 req-45f8c35a-68ce-45fb-ab12-955b4994d75b service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:24.342765 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-683129e8-cd47-4f15-80ba-acd1385786e9 req-45f8c35a-68ce-45fb-ab12-955b4994d75b service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:24.356050 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-683129e8-cd47-4f15-80ba-acd1385786e9 req-45f8c35a-68ce-45fb-ab12-955b4994d75b service nova] Creating event network-vif-plugged:82d9ed45-eecf-4842-8a43-0e5549e8b8a9 for instance a9d18297-c3bf-4b67-b775-1121be87da07 on hv-cinder-83769 May 16 17:48:24.360900 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-683129e8-cd47-4f15-80ba-acd1385786e9 req-45f8c35a-68ce-45fb-ab12-955b4994d75b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030663 May 16 17:48:24.361501 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 407/833] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:48:24.710422 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8195b520-b1bd-47f7-a3ee-268cadf4de39 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:24.711212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-8195b520-b1bd-47f7-a3ee-268cadf4de39 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:24.719632 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8195b520-b1bd-47f7-a3ee-268cadf4de39 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:24.720081 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8195b520-b1bd-47f7-a3ee-268cadf4de39 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:24.720863 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8195b520-b1bd-47f7-a3ee-268cadf4de39 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:24.721303 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8195b520-b1bd-47f7-a3ee-268cadf4de39 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:24.862147 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-8195b520-b1bd-47f7-a3ee-268cadf4de39 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:24.869970 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-8195b520-b1bd-47f7-a3ee-268cadf4de39 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1265 microversion: 2.1 time: 0.164770 May 16 17:48:24.870507 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 427/834] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:48:24 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:25.192325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-8288295b-5fde-4fdb-8ad8-d51de90e8a13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:25.193005 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-8288295b-5fde-4fdb-8ad8-d51de90e8a13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:25.201060 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8288295b-5fde-4fdb-8ad8-d51de90e8a13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:25.201586 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8288295b-5fde-4fdb-8ad8-d51de90e8a13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:25.202496 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8288295b-5fde-4fdb-8ad8-d51de90e8a13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:25.202997 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8288295b-5fde-4fdb-8ad8-d51de90e8a13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:25.345685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-8288295b-5fde-4fdb-8ad8-d51de90e8a13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:25.354436 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-8288295b-5fde-4fdb-8ad8-d51de90e8a13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:25.355942 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-8288295b-5fde-4fdb-8ad8-d51de90e8a13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:25.357043 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-8288295b-5fde-4fdb-8ad8-d51de90e8a13 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1407 microversion: 2.20 time: 0.170441 May 16 17:48:25.357673 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 408/835] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:48:25 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:48:25.887510 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ecfd6498-31aa-42a3-a42d-f6795b193da1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:25.888149 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ecfd6498-31aa-42a3-a42d-f6795b193da1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:25.895945 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ecfd6498-31aa-42a3-a42d-f6795b193da1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:25.896398 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ecfd6498-31aa-42a3-a42d-f6795b193da1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:25.897174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ecfd6498-31aa-42a3-a42d-f6795b193da1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:25.897633 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ecfd6498-31aa-42a3-a42d-f6795b193da1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:26.031493 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ecfd6498-31aa-42a3-a42d-f6795b193da1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:26.039525 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ecfd6498-31aa-42a3-a42d-f6795b193da1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1265 microversion: 2.1 time: 0.156113 May 16 17:48:26.040099 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 428/836] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:48:25 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:26.378261 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-8fdbf799-77ec-4301-ab6a-385d7b3c8a2e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:26.379253 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-8fdbf799-77ec-4301-ab6a-385d7b3c8a2e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:26.390401 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8fdbf799-77ec-4301-ab6a-385d7b3c8a2e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:26.390844 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8fdbf799-77ec-4301-ab6a-385d7b3c8a2e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:26.391592 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8fdbf799-77ec-4301-ab6a-385d7b3c8a2e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:26.392020 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8fdbf799-77ec-4301-ab6a-385d7b3c8a2e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:26.539550 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-8fdbf799-77ec-4301-ab6a-385d7b3c8a2e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:26.550075 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-8fdbf799-77ec-4301-ab6a-385d7b3c8a2e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:26.551581 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-8fdbf799-77ec-4301-ab6a-385d7b3c8a2e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:26.552746 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-8fdbf799-77ec-4301-ab6a-385d7b3c8a2e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1599 microversion: 2.20 time: 0.180942 May 16 17:48:26.553313 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 409/837] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:48:26 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1599 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:48:26.569925 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f47d76f2-1aa0-4b48-8eb4-685c2ccba41d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:26.570412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-f47d76f2-1aa0-4b48-8eb4-685c2ccba41d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:26.576823 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f47d76f2-1aa0-4b48-8eb4-685c2ccba41d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:26.577268 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f47d76f2-1aa0-4b48-8eb4-685c2ccba41d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:26.578101 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f47d76f2-1aa0-4b48-8eb4-685c2ccba41d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:26.578528 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f47d76f2-1aa0-4b48-8eb4-685c2ccba41d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:26.658847 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f47d76f2-1aa0-4b48-8eb4-685c2ccba41d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092741 May 16 17:48:26.659753 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 429/838] 10.222.0.58 () {60 vars in 1315 bytes} [Mon May 16 17:48:26 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:48:27.059799 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f2b12c0b-4ba8-484b-b6de-97fcabd3ee50 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:27.061392 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-f2b12c0b-4ba8-484b-b6de-97fcabd3ee50 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:27.067989 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f2b12c0b-4ba8-484b-b6de-97fcabd3ee50 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:27.068468 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f2b12c0b-4ba8-484b-b6de-97fcabd3ee50 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:27.069330 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f2b12c0b-4ba8-484b-b6de-97fcabd3ee50 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:27.069819 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f2b12c0b-4ba8-484b-b6de-97fcabd3ee50 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:27.290672 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f2b12c0b-4ba8-484b-b6de-97fcabd3ee50 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:27.298208 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f2b12c0b-4ba8-484b-b6de-97fcabd3ee50 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1265 microversion: 2.1 time: 0.245283 May 16 17:48:27.298745 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 410/839] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:48:27 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:27.653761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-769296f0-8eee-4d69-bc69-0d26f3681051 req-198b1567-a75c-461d-959c-dbce114f1b3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9d18297-c3bf-4b67-b775-1121be87da07", "tag": "82d9ed45-eecf-4842-8a43-0e5549e8b8a9"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:48:27.662613 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-769296f0-8eee-4d69-bc69-0d26f3681051 req-198b1567-a75c-461d-959c-dbce114f1b3b service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:27.663060 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-769296f0-8eee-4d69-bc69-0d26f3681051 req-198b1567-a75c-461d-959c-dbce114f1b3b service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:27.674830 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-769296f0-8eee-4d69-bc69-0d26f3681051 req-198b1567-a75c-461d-959c-dbce114f1b3b service nova] Creating event network-changed:82d9ed45-eecf-4842-8a43-0e5549e8b8a9 for instance a9d18297-c3bf-4b67-b775-1121be87da07 on hv-cinder-83769 May 16 17:48:27.680242 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-769296f0-8eee-4d69-bc69-0d26f3681051 req-198b1567-a75c-461d-959c-dbce114f1b3b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030701 May 16 17:48:27.681102 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 430/840] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:48:28.314836 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c1bb523c-322f-4b36-b187-c2fe65f04ca6 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:28.315433 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-c1bb523c-322f-4b36-b187-c2fe65f04ca6 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:28.322204 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c1bb523c-322f-4b36-b187-c2fe65f04ca6 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:28.322655 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c1bb523c-322f-4b36-b187-c2fe65f04ca6 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:28.323467 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c1bb523c-322f-4b36-b187-c2fe65f04ca6 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:28.323866 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c1bb523c-322f-4b36-b187-c2fe65f04ca6 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:28.466082 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-c1bb523c-322f-4b36-b187-c2fe65f04ca6 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:28.473889 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-c1bb523c-322f-4b36-b187-c2fe65f04ca6 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1265 microversion: 2.1 time: 0.163129 May 16 17:48:28.474451 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 411/841] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:48:28 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:29.496433 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d6f5531d-845e-45ce-bf3c-02e69babf36d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:29.497624 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d6f5531d-845e-45ce-bf3c-02e69babf36d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:29.508304 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d6f5531d-845e-45ce-bf3c-02e69babf36d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:29.509052 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d6f5531d-845e-45ce-bf3c-02e69babf36d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:29.510436 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d6f5531d-845e-45ce-bf3c-02e69babf36d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:29.511152 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d6f5531d-845e-45ce-bf3c-02e69babf36d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:29.647371 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d6f5531d-845e-45ce-bf3c-02e69babf36d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:29.655415 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d6f5531d-845e-45ce-bf3c-02e69babf36d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1265 microversion: 2.1 time: 0.166803 May 16 17:48:29.655983 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 431/842] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:48:29 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:30.672599 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b78b5f59-9851-4386-9554-9433c7a10681 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:30.673234 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b78b5f59-9851-4386-9554-9433c7a10681 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:30.680070 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b78b5f59-9851-4386-9554-9433c7a10681 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:30.680533 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b78b5f59-9851-4386-9554-9433c7a10681 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:30.681278 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b78b5f59-9851-4386-9554-9433c7a10681 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:30.681750 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b78b5f59-9851-4386-9554-9433c7a10681 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:30.811952 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-b78b5f59-9851-4386-9554-9433c7a10681 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:30.819221 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b78b5f59-9851-4386-9554-9433c7a10681 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1265 microversion: 2.1 time: 0.150604 May 16 17:48:30.820013 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 412/843] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:48:30 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:31.840663 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-83c5f8df-8c43-4d62-be11-58d11139b09a tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:31.841513 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-83c5f8df-8c43-4d62-be11-58d11139b09a tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:31.852305 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-83c5f8df-8c43-4d62-be11-58d11139b09a tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:31.853054 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-83c5f8df-8c43-4d62-be11-58d11139b09a tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:31.854385 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-83c5f8df-8c43-4d62-be11-58d11139b09a tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:31.855110 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-83c5f8df-8c43-4d62-be11-58d11139b09a tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:32.254170 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-83c5f8df-8c43-4d62-be11-58d11139b09a tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:32.261994 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-83c5f8df-8c43-4d62-be11-58d11139b09a tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1265 microversion: 2.1 time: 0.428090 May 16 17:48:32.262566 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 432/844] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:48:31 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1265 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:32.452960 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-405e196a-c78b-42a0-8963-f50e18849b65 req-e5577508-0cba-4161-8aba-803adb206775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9279a4c5-c764-46b4-8028-3bb0d8de0406", "name": "network-vif-plugged", "status": "completed", "tag": "59abc649-1713-4a6f-b4af-005a342766ce"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:48:32.462435 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-405e196a-c78b-42a0-8963-f50e18849b65 req-e5577508-0cba-4161-8aba-803adb206775 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:32.462903 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-405e196a-c78b-42a0-8963-f50e18849b65 req-e5577508-0cba-4161-8aba-803adb206775 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:32.474735 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-405e196a-c78b-42a0-8963-f50e18849b65 req-e5577508-0cba-4161-8aba-803adb206775 service nova] Creating event network-vif-plugged:59abc649-1713-4a6f-b4af-005a342766ce for instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 on hv-cinder-83769 May 16 17:48:32.479569 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-405e196a-c78b-42a0-8963-f50e18849b65 req-e5577508-0cba-4161-8aba-803adb206775 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030453 May 16 17:48:32.480247 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 413/845] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:48:33.282843 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-89848f30-682e-4e2e-860e-7a7791d2df5b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:33.283840 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-89848f30-682e-4e2e-860e-7a7791d2df5b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:33.294976 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-89848f30-682e-4e2e-860e-7a7791d2df5b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:33.295720 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-89848f30-682e-4e2e-860e-7a7791d2df5b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:33.296779 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-89848f30-682e-4e2e-860e-7a7791d2df5b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:33.297213 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-89848f30-682e-4e2e-860e-7a7791d2df5b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:33.433021 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-89848f30-682e-4e2e-860e-7a7791d2df5b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:33.442084 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-89848f30-682e-4e2e-860e-7a7791d2df5b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1265 microversion: 2.1 time: 0.165768 May 16 17:48:33.442618 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 433/846] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:48:33 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:34.464696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-7b15cb74-807e-44d3-aad3-dd19fad75550 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:34.465742 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-7b15cb74-807e-44d3-aad3-dd19fad75550 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:34.473316 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7b15cb74-807e-44d3-aad3-dd19fad75550 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:34.473791 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7b15cb74-807e-44d3-aad3-dd19fad75550 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:34.474559 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7b15cb74-807e-44d3-aad3-dd19fad75550 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:34.474990 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7b15cb74-807e-44d3-aad3-dd19fad75550 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:34.612926 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-7b15cb74-807e-44d3-aad3-dd19fad75550 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:34.620484 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-7b15cb74-807e-44d3-aad3-dd19fad75550 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1453 microversion: 2.1 time: 0.163857 May 16 17:48:34.621074 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 414/847] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:48:34 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:34.636590 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-27e72954-4c98-4cde-aff4-c53c1eb69af6 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:48:34.637205 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-27e72954-4c98-4cde-aff4-c53c1eb69af6 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:48:34.643556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-27e72954-4c98-4cde-aff4-c53c1eb69af6 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:34.644000 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-27e72954-4c98-4cde-aff4-c53c1eb69af6 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:34.644758 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-27e72954-4c98-4cde-aff4-c53c1eb69af6 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:34.645199 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-27e72954-4c98-4cde-aff4-c53c1eb69af6 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:34.785821 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-27e72954-4c98-4cde-aff4-c53c1eb69af6 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:48:34.797207 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-27e72954-4c98-4cde-aff4-c53c1eb69af6 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1453 microversion: 2.1 time: 0.164468 May 16 17:48:34.797799 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 434/848] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:48:34 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:48:36.532999 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-bf3eea0c-876d-4883-ac59-e2f6d66f77a2 req-b9b4a2c6-f3a8-43af-b60a-b0eaceecf3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9279a4c5-c764-46b4-8028-3bb0d8de0406", "tag": "59abc649-1713-4a6f-b4af-005a342766ce"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:48:36.542015 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-bf3eea0c-876d-4883-ac59-e2f6d66f77a2 req-b9b4a2c6-f3a8-43af-b60a-b0eaceecf3f9 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:48:36.542424 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-bf3eea0c-876d-4883-ac59-e2f6d66f77a2 req-b9b4a2c6-f3a8-43af-b60a-b0eaceecf3f9 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:48:36.553328 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-bf3eea0c-876d-4883-ac59-e2f6d66f77a2 req-b9b4a2c6-f3a8-43af-b60a-b0eaceecf3f9 service nova] Creating event network-changed:59abc649-1713-4a6f-b4af-005a342766ce for instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 on hv-cinder-83769 May 16 17:48:36.558367 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-bf3eea0c-876d-4883-ac59-e2f6d66f77a2 req-b9b4a2c6-f3a8-43af-b60a-b0eaceecf3f9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029290 May 16 17:48:36.559157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 415/849] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:49:03.518238 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ab9e2dc3-f0a2-492d-9cfc-ba93f600d56d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:03.519219 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ab9e2dc3-f0a2-492d-9cfc-ba93f600d56d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:03.530286 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ab9e2dc3-f0a2-492d-9cfc-ba93f600d56d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:03.530777 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ab9e2dc3-f0a2-492d-9cfc-ba93f600d56d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:03.531649 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ab9e2dc3-f0a2-492d-9cfc-ba93f600d56d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:03.532084 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ab9e2dc3-f0a2-492d-9cfc-ba93f600d56d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:03.556001 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ab9e2dc3-f0a2-492d-9cfc-ba93f600d56d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07/ips" status: 200 len: 152 microversion: 2.20 time: 0.044894 May 16 17:49:03.556588 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 435/850] 10.222.0.58 () {60 vars in 1288 bytes} [Mon May 16 17:49:03 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07/ips => generated 152 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:49:05.517882 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-983b94af-492a-4526-933d-6816e0672c7f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:49:05.518472 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-983b94af-492a-4526-933d-6816e0672c7f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:05.525238 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-983b94af-492a-4526-933d-6816e0672c7f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:05.525756 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-983b94af-492a-4526-933d-6816e0672c7f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:05.526529 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-983b94af-492a-4526-933d-6816e0672c7f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:05.526965 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-983b94af-492a-4526-933d-6816e0672c7f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:05.551384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-983b94af-492a-4526-933d-6816e0672c7f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lazy-loading 'flavor' on Instance uuid a9d18297-c3bf-4b67-b775-1121be87da07 {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:49:05.837792 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-983b94af-492a-4526-933d-6816e0672c7f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "POST /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07/action" status: 202 len: 0 microversion: 2.20 time: 0.325082 May 16 17:49:05.838415 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 416/851] 10.222.0.58 () {62 vars in 1318 bytes} [Mon May 16 17:49:05 2022] POST /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 17:49:05.846663 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-5f0466c0-56e1-49b8-8477-1d6ecc5b5ce6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:05.847276 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-5f0466c0-56e1-49b8-8477-1d6ecc5b5ce6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:05.854118 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5f0466c0-56e1-49b8-8477-1d6ecc5b5ce6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:05.854602 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5f0466c0-56e1-49b8-8477-1d6ecc5b5ce6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:05.855468 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5f0466c0-56e1-49b8-8477-1d6ecc5b5ce6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:05.855966 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-5f0466c0-56e1-49b8-8477-1d6ecc5b5ce6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:05.993007 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-5f0466c0-56e1-49b8-8477-1d6ecc5b5ce6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:06.001137 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-5f0466c0-56e1-49b8-8477-1d6ecc5b5ce6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:06.002634 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-5f0466c0-56e1-49b8-8477-1d6ecc5b5ce6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:06.003905 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-5f0466c0-56e1-49b8-8477-1d6ecc5b5ce6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1724 microversion: 2.20 time: 0.161095 May 16 17:49:06.004408 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 436/852] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:05 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:07.025747 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e9949436-fd8a-4403-8e64-1a711ddea918 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:07.026414 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e9949436-fd8a-4403-8e64-1a711ddea918 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:07.034981 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e9949436-fd8a-4403-8e64-1a711ddea918 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:07.035487 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e9949436-fd8a-4403-8e64-1a711ddea918 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:07.037124 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e9949436-fd8a-4403-8e64-1a711ddea918 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:07.038126 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e9949436-fd8a-4403-8e64-1a711ddea918 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:07.176856 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e9949436-fd8a-4403-8e64-1a711ddea918 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:07.184785 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e9949436-fd8a-4403-8e64-1a711ddea918 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:07.186351 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e9949436-fd8a-4403-8e64-1a711ddea918 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:07.187476 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e9949436-fd8a-4403-8e64-1a711ddea918 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1724 microversion: 2.20 time: 0.168005 May 16 17:49:07.188037 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 417/853] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:07 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:08.209741 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8188a186-6c75-46f7-afb6-7a8727970eb1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:08.210597 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-8188a186-6c75-46f7-afb6-7a8727970eb1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:08.220016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8188a186-6c75-46f7-afb6-7a8727970eb1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:08.220460 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8188a186-6c75-46f7-afb6-7a8727970eb1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:08.221291 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8188a186-6c75-46f7-afb6-7a8727970eb1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:08.221762 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8188a186-6c75-46f7-afb6-7a8727970eb1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:08.404421 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-8188a186-6c75-46f7-afb6-7a8727970eb1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:08.412989 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-8188a186-6c75-46f7-afb6-7a8727970eb1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:08.414520 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-8188a186-6c75-46f7-afb6-7a8727970eb1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:08.415677 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-8188a186-6c75-46f7-afb6-7a8727970eb1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1724 microversion: 2.20 time: 0.212602 May 16 17:49:08.416240 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 437/854] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:08 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:09.437360 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-009e6f69-a026-4cbc-998e-f57e1379a312 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:09.437994 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-009e6f69-a026-4cbc-998e-f57e1379a312 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:09.444328 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-009e6f69-a026-4cbc-998e-f57e1379a312 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:09.444766 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-009e6f69-a026-4cbc-998e-f57e1379a312 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:09.445533 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-009e6f69-a026-4cbc-998e-f57e1379a312 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:09.445988 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-009e6f69-a026-4cbc-998e-f57e1379a312 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:09.582062 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-009e6f69-a026-4cbc-998e-f57e1379a312 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:09.590409 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-009e6f69-a026-4cbc-998e-f57e1379a312 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:09.591901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-009e6f69-a026-4cbc-998e-f57e1379a312 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:09.593096 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-009e6f69-a026-4cbc-998e-f57e1379a312 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1724 microversion: 2.20 time: 0.161738 May 16 17:49:09.593672 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 418/855] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:09 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:10.615515 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ad67a78c-acb4-45cd-befc-395c4d289172 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:10.616420 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ad67a78c-acb4-45cd-befc-395c4d289172 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:10.627086 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ad67a78c-acb4-45cd-befc-395c4d289172 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:10.627831 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ad67a78c-acb4-45cd-befc-395c4d289172 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:10.629054 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ad67a78c-acb4-45cd-befc-395c4d289172 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:10.629810 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ad67a78c-acb4-45cd-befc-395c4d289172 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:10.763767 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ad67a78c-acb4-45cd-befc-395c4d289172 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:10.772091 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ad67a78c-acb4-45cd-befc-395c4d289172 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:10.773587 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ad67a78c-acb4-45cd-befc-395c4d289172 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:10.774783 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ad67a78c-acb4-45cd-befc-395c4d289172 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1724 microversion: 2.20 time: 0.165938 May 16 17:49:10.775351 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 438/856] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:10 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:11.799213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-45aaefb2-a8a4-4f9a-a6cc-12bc2bb27786 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:11.799868 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-45aaefb2-a8a4-4f9a-a6cc-12bc2bb27786 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:11.808957 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-45aaefb2-a8a4-4f9a-a6cc-12bc2bb27786 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:11.809647 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-45aaefb2-a8a4-4f9a-a6cc-12bc2bb27786 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:11.810704 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-45aaefb2-a8a4-4f9a-a6cc-12bc2bb27786 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:11.811344 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-45aaefb2-a8a4-4f9a-a6cc-12bc2bb27786 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:11.953422 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-45aaefb2-a8a4-4f9a-a6cc-12bc2bb27786 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:11.965059 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-45aaefb2-a8a4-4f9a-a6cc-12bc2bb27786 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:11.966594 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-45aaefb2-a8a4-4f9a-a6cc-12bc2bb27786 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:11.967910 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-45aaefb2-a8a4-4f9a-a6cc-12bc2bb27786 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1724 microversion: 2.20 time: 0.176706 May 16 17:49:11.968514 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 419/857] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:11 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:12.988039 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-2333f2b5-def2-4855-b125-fe2045ac861c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:12.988751 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-2333f2b5-def2-4855-b125-fe2045ac861c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:12.996603 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2333f2b5-def2-4855-b125-fe2045ac861c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:12.997053 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2333f2b5-def2-4855-b125-fe2045ac861c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:12.997862 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2333f2b5-def2-4855-b125-fe2045ac861c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:12.998360 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2333f2b5-def2-4855-b125-fe2045ac861c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:13.140154 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-2333f2b5-def2-4855-b125-fe2045ac861c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:13.148753 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-2333f2b5-def2-4855-b125-fe2045ac861c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:13.150300 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-2333f2b5-def2-4855-b125-fe2045ac861c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:13.151470 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-2333f2b5-def2-4855-b125-fe2045ac861c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1724 microversion: 2.20 time: 0.168305 May 16 17:49:13.152031 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 439/858] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:12 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:49:14.170121 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e94bc685-848f-43a2-958c-9620dde14792 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:14.170728 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e94bc685-848f-43a2-958c-9620dde14792 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:14.177571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e94bc685-848f-43a2-958c-9620dde14792 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:14.178036 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e94bc685-848f-43a2-958c-9620dde14792 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:14.178816 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e94bc685-848f-43a2-958c-9620dde14792 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:14.179219 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e94bc685-848f-43a2-958c-9620dde14792 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:14.319652 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e94bc685-848f-43a2-958c-9620dde14792 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:14.327999 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e94bc685-848f-43a2-958c-9620dde14792 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:14.329577 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e94bc685-848f-43a2-958c-9620dde14792 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:14.330793 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e94bc685-848f-43a2-958c-9620dde14792 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1724 microversion: 2.20 time: 0.164674 May 16 17:49:14.331355 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 420/859] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:14 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:15.353133 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-dd6cebd4-0a51-489e-a5f1-0a5aa9d037a0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:15.354314 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-dd6cebd4-0a51-489e-a5f1-0a5aa9d037a0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:15.362741 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dd6cebd4-0a51-489e-a5f1-0a5aa9d037a0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:15.363191 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dd6cebd4-0a51-489e-a5f1-0a5aa9d037a0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:15.363951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dd6cebd4-0a51-489e-a5f1-0a5aa9d037a0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:15.364389 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-dd6cebd4-0a51-489e-a5f1-0a5aa9d037a0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:15.494224 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-dd6cebd4-0a51-489e-a5f1-0a5aa9d037a0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:15.502936 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-dd6cebd4-0a51-489e-a5f1-0a5aa9d037a0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:15.504416 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-dd6cebd4-0a51-489e-a5f1-0a5aa9d037a0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:15.505570 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-dd6cebd4-0a51-489e-a5f1-0a5aa9d037a0 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1724 microversion: 2.20 time: 0.158962 May 16 17:49:15.506129 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 440/860] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:15 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:16.534149 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-771842b1-358e-4a1b-b717-3249bdb5f6d1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:16.535556 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-771842b1-358e-4a1b-b717-3249bdb5f6d1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:16.545846 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-771842b1-358e-4a1b-b717-3249bdb5f6d1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:16.546755 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-771842b1-358e-4a1b-b717-3249bdb5f6d1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:16.547734 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-771842b1-358e-4a1b-b717-3249bdb5f6d1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:16.548277 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-771842b1-358e-4a1b-b717-3249bdb5f6d1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:16.683905 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-771842b1-358e-4a1b-b717-3249bdb5f6d1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:16.691779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-771842b1-358e-4a1b-b717-3249bdb5f6d1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:16.693254 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-771842b1-358e-4a1b-b717-3249bdb5f6d1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:16.694454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-771842b1-358e-4a1b-b717-3249bdb5f6d1 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1724 microversion: 2.20 time: 0.168159 May 16 17:49:16.695016 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 421/861] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:16 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:17.716729 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-45fc2d2a-99d7-40e6-b420-e472968606d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:17.717745 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-45fc2d2a-99d7-40e6-b420-e472968606d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:17.726573 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-45fc2d2a-99d7-40e6-b420-e472968606d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:17.727347 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-45fc2d2a-99d7-40e6-b420-e472968606d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:17.728633 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-45fc2d2a-99d7-40e6-b420-e472968606d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:17.729365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-45fc2d2a-99d7-40e6-b420-e472968606d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:17.875916 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-45fc2d2a-99d7-40e6-b420-e472968606d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:17.888544 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-45fc2d2a-99d7-40e6-b420-e472968606d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:17.890966 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-45fc2d2a-99d7-40e6-b420-e472968606d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:17.892471 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-45fc2d2a-99d7-40e6-b420-e472968606d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1724 microversion: 2.20 time: 0.182091 May 16 17:49:17.893236 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 441/862] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:17 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:18.919805 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4fa8cf01-8558-4a0c-b595-9f89c60a9577 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:18.920752 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4fa8cf01-8558-4a0c-b595-9f89c60a9577 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:18.927798 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4fa8cf01-8558-4a0c-b595-9f89c60a9577 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:18.928263 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4fa8cf01-8558-4a0c-b595-9f89c60a9577 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:18.929060 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4fa8cf01-8558-4a0c-b595-9f89c60a9577 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:18.929512 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4fa8cf01-8558-4a0c-b595-9f89c60a9577 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:19.061263 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-4fa8cf01-8558-4a0c-b595-9f89c60a9577 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:19.069182 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-4fa8cf01-8558-4a0c-b595-9f89c60a9577 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:19.070707 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-4fa8cf01-8558-4a0c-b595-9f89c60a9577 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:19.071827 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4fa8cf01-8558-4a0c-b595-9f89c60a9577 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1724 microversion: 2.20 time: 0.159031 May 16 17:49:19.072388 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 422/863] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:18 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:20.095729 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-c81fae66-afdf-4af1-9bbf-776433406961 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:20.096723 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-c81fae66-afdf-4af1-9bbf-776433406961 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:20.108046 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c81fae66-afdf-4af1-9bbf-776433406961 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:20.108781 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c81fae66-afdf-4af1-9bbf-776433406961 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:20.110082 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c81fae66-afdf-4af1-9bbf-776433406961 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:20.110800 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c81fae66-afdf-4af1-9bbf-776433406961 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:20.254123 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-c81fae66-afdf-4af1-9bbf-776433406961 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:20.261973 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-c81fae66-afdf-4af1-9bbf-776433406961 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:20.263440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-c81fae66-afdf-4af1-9bbf-776433406961 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:20.264577 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-c81fae66-afdf-4af1-9bbf-776433406961 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1724 microversion: 2.20 time: 0.175540 May 16 17:49:20.265136 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 442/864] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:20 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:21.285609 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-466f51d3-1bcf-425c-b2d4-49f295294c20 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:21.286713 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-466f51d3-1bcf-425c-b2d4-49f295294c20 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:21.299093 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-466f51d3-1bcf-425c-b2d4-49f295294c20 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:21.299534 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-466f51d3-1bcf-425c-b2d4-49f295294c20 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:21.300293 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-466f51d3-1bcf-425c-b2d4-49f295294c20 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:21.300713 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-466f51d3-1bcf-425c-b2d4-49f295294c20 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:21.437408 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-466f51d3-1bcf-425c-b2d4-49f295294c20 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:21.446000 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-466f51d3-1bcf-425c-b2d4-49f295294c20 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:21.447495 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-466f51d3-1bcf-425c-b2d4-49f295294c20 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:21.448652 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-466f51d3-1bcf-425c-b2d4-49f295294c20 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1745 microversion: 2.20 time: 0.169553 May 16 17:49:21.449212 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 423/865] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:21 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:22.471585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-828df84c-33da-4909-93cf-8bff5b30cfc7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:22.472642 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-828df84c-33da-4909-93cf-8bff5b30cfc7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:22.483821 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-828df84c-33da-4909-93cf-8bff5b30cfc7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:22.484561 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-828df84c-33da-4909-93cf-8bff5b30cfc7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:22.485868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-828df84c-33da-4909-93cf-8bff5b30cfc7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:22.486579 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-828df84c-33da-4909-93cf-8bff5b30cfc7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:22.631437 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-828df84c-33da-4909-93cf-8bff5b30cfc7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:22.639798 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-828df84c-33da-4909-93cf-8bff5b30cfc7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:22.641263 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-828df84c-33da-4909-93cf-8bff5b30cfc7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:22.642438 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-828df84c-33da-4909-93cf-8bff5b30cfc7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1745 microversion: 2.20 time: 0.177816 May 16 17:49:22.643009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 443/866] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:22 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:23.660311 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-07ee0735-7ab2-435c-8417-04ef283ec299 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:23.660905 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-07ee0735-7ab2-435c-8417-04ef283ec299 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:23.668120 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-07ee0735-7ab2-435c-8417-04ef283ec299 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:23.668602 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-07ee0735-7ab2-435c-8417-04ef283ec299 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:23.669404 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-07ee0735-7ab2-435c-8417-04ef283ec299 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:23.669896 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-07ee0735-7ab2-435c-8417-04ef283ec299 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:23.802190 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-07ee0735-7ab2-435c-8417-04ef283ec299 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:23.818948 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-07ee0735-7ab2-435c-8417-04ef283ec299 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:23.820661 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-07ee0735-7ab2-435c-8417-04ef283ec299 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:23.821931 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-07ee0735-7ab2-435c-8417-04ef283ec299 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1740 microversion: 2.20 time: 0.165622 May 16 17:49:23.822890 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 424/867] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:23 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:49:24.844398 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8f7c2a5b-023a-4d14-9c59-f18554405eb6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:24.845036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-8f7c2a5b-023a-4d14-9c59-f18554405eb6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:24.867394 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8f7c2a5b-023a-4d14-9c59-f18554405eb6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:24.867843 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8f7c2a5b-023a-4d14-9c59-f18554405eb6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:24.868628 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8f7c2a5b-023a-4d14-9c59-f18554405eb6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:24.869057 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8f7c2a5b-023a-4d14-9c59-f18554405eb6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:25.021282 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-8f7c2a5b-023a-4d14-9c59-f18554405eb6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:25.029147 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-8f7c2a5b-023a-4d14-9c59-f18554405eb6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:25.031304 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-8f7c2a5b-023a-4d14-9c59-f18554405eb6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:25.032702 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-8f7c2a5b-023a-4d14-9c59-f18554405eb6 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1740 microversion: 2.20 time: 0.192436 May 16 17:49:25.033265 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 444/868] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:24 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:26.051676 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c29786f0-7510-4324-8c62-a991d42a6c22 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:26.052264 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-c29786f0-7510-4324-8c62-a991d42a6c22 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:26.060861 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c29786f0-7510-4324-8c62-a991d42a6c22 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:26.061388 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c29786f0-7510-4324-8c62-a991d42a6c22 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:26.062246 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c29786f0-7510-4324-8c62-a991d42a6c22 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:26.062683 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c29786f0-7510-4324-8c62-a991d42a6c22 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:26.246987 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-c29786f0-7510-4324-8c62-a991d42a6c22 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:26.255934 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-c29786f0-7510-4324-8c62-a991d42a6c22 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:26.257419 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-c29786f0-7510-4324-8c62-a991d42a6c22 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:26.258587 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-c29786f0-7510-4324-8c62-a991d42a6c22 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1740 microversion: 2.20 time: 0.211309 May 16 17:49:26.259146 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 425/869] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:26 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:26.714410 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-bc5d4af9-6207-40fc-99c4-8305be42d517 req-4c87d59a-a9cc-4bc7-94ea-288963517476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d18297-c3bf-4b67-b775-1121be87da07", "name": "network-vif-plugged", "status": "completed", "tag": "82d9ed45-eecf-4842-8a43-0e5549e8b8a9"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:49:26.726252 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-bc5d4af9-6207-40fc-99c4-8305be42d517 req-4c87d59a-a9cc-4bc7-94ea-288963517476 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:26.727305 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-bc5d4af9-6207-40fc-99c4-8305be42d517 req-4c87d59a-a9cc-4bc7-94ea-288963517476 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:26.740706 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-bc5d4af9-6207-40fc-99c4-8305be42d517 req-4c87d59a-a9cc-4bc7-94ea-288963517476 service nova] Creating event network-vif-plugged:82d9ed45-eecf-4842-8a43-0e5549e8b8a9 for instance a9d18297-c3bf-4b67-b775-1121be87da07 on hv-cinder-83769 May 16 17:49:26.747095 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-bc5d4af9-6207-40fc-99c4-8305be42d517 req-4c87d59a-a9cc-4bc7-94ea-288963517476 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036193 May 16 17:49:26.748608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 445/870] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:49:27.276264 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-2b845359-fc2b-4900-a5c3-01e0c6d418d5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:27.277686 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-2b845359-fc2b-4900-a5c3-01e0c6d418d5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:27.284907 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2b845359-fc2b-4900-a5c3-01e0c6d418d5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:27.285832 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2b845359-fc2b-4900-a5c3-01e0c6d418d5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:27.286706 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2b845359-fc2b-4900-a5c3-01e0c6d418d5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:27.287337 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2b845359-fc2b-4900-a5c3-01e0c6d418d5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:27.430138 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-2b845359-fc2b-4900-a5c3-01e0c6d418d5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:27.443071 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-2b845359-fc2b-4900-a5c3-01e0c6d418d5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:27.444566 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-2b845359-fc2b-4900-a5c3-01e0c6d418d5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:27.445762 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-2b845359-fc2b-4900-a5c3-01e0c6d418d5 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1740 microversion: 2.20 time: 0.173379 May 16 17:49:27.446506 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 426/871] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:27 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:28.469028 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-b420067a-b3ef-4a35-b109-f7e35c6c4f30 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:28.470377 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b420067a-b3ef-4a35-b109-f7e35c6c4f30 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:28.476826 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b420067a-b3ef-4a35-b109-f7e35c6c4f30 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:28.477268 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b420067a-b3ef-4a35-b109-f7e35c6c4f30 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:28.478055 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b420067a-b3ef-4a35-b109-f7e35c6c4f30 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:28.478478 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b420067a-b3ef-4a35-b109-f7e35c6c4f30 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:28.889662 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b420067a-b3ef-4a35-b109-f7e35c6c4f30 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:28.898326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b420067a-b3ef-4a35-b109-f7e35c6c4f30 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:28.900084 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b420067a-b3ef-4a35-b109-f7e35c6c4f30 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:28.901479 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-b420067a-b3ef-4a35-b109-f7e35c6c4f30 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1740 microversion: 2.20 time: 0.437350 May 16 17:49:28.912488 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 446/872] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:28 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1740 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:29.921500 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-74a90fe7-41aa-4313-92d2-7fb5c353ec5a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:29.922090 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-74a90fe7-41aa-4313-92d2-7fb5c353ec5a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:29.928726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-74a90fe7-41aa-4313-92d2-7fb5c353ec5a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:29.929179 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-74a90fe7-41aa-4313-92d2-7fb5c353ec5a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:29.929995 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-74a90fe7-41aa-4313-92d2-7fb5c353ec5a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:29.930423 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-74a90fe7-41aa-4313-92d2-7fb5c353ec5a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:30.065133 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-74a90fe7-41aa-4313-92d2-7fb5c353ec5a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:30.073386 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-74a90fe7-41aa-4313-92d2-7fb5c353ec5a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:30.075090 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-74a90fe7-41aa-4313-92d2-7fb5c353ec5a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:30.076251 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-74a90fe7-41aa-4313-92d2-7fb5c353ec5a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1740 microversion: 2.20 time: 0.160071 May 16 17:49:30.076874 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 427/873] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:29 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:31.094467 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-71f9818d-9472-41d1-941c-cdb0fe0b2796 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:31.095830 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-71f9818d-9472-41d1-941c-cdb0fe0b2796 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:31.102538 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-71f9818d-9472-41d1-941c-cdb0fe0b2796 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:31.103189 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-71f9818d-9472-41d1-941c-cdb0fe0b2796 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:31.104189 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-71f9818d-9472-41d1-941c-cdb0fe0b2796 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:31.104761 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-71f9818d-9472-41d1-941c-cdb0fe0b2796 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:31.245945 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-71f9818d-9472-41d1-941c-cdb0fe0b2796 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:31.254937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-71f9818d-9472-41d1-941c-cdb0fe0b2796 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:31.257030 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-71f9818d-9472-41d1-941c-cdb0fe0b2796 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:31.258592 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-71f9818d-9472-41d1-941c-cdb0fe0b2796 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1740 microversion: 2.20 time: 0.168046 May 16 17:49:31.259525 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 447/874] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:31 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:32.276475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f7cec3fc-ccdd-47af-b2da-63f11b60eab3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:32.277080 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-f7cec3fc-ccdd-47af-b2da-63f11b60eab3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:32.283931 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f7cec3fc-ccdd-47af-b2da-63f11b60eab3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:32.284374 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f7cec3fc-ccdd-47af-b2da-63f11b60eab3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:32.285226 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f7cec3fc-ccdd-47af-b2da-63f11b60eab3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:32.285687 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f7cec3fc-ccdd-47af-b2da-63f11b60eab3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:32.414790 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f7cec3fc-ccdd-47af-b2da-63f11b60eab3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:32.422972 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f7cec3fc-ccdd-47af-b2da-63f11b60eab3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:32.424448 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f7cec3fc-ccdd-47af-b2da-63f11b60eab3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:32.425621 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f7cec3fc-ccdd-47af-b2da-63f11b60eab3 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1740 microversion: 2.20 time: 0.153229 May 16 17:49:32.426176 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 428/875] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:32 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:33.444319 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-b415c6bd-e8e0-4e0c-9ccc-67f73fddd8e9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:33.444995 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b415c6bd-e8e0-4e0c-9ccc-67f73fddd8e9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:33.451862 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b415c6bd-e8e0-4e0c-9ccc-67f73fddd8e9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:33.452295 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b415c6bd-e8e0-4e0c-9ccc-67f73fddd8e9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:33.453070 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b415c6bd-e8e0-4e0c-9ccc-67f73fddd8e9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:33.453505 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b415c6bd-e8e0-4e0c-9ccc-67f73fddd8e9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:33.587880 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b415c6bd-e8e0-4e0c-9ccc-67f73fddd8e9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:33.596303 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b415c6bd-e8e0-4e0c-9ccc-67f73fddd8e9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:33.597832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b415c6bd-e8e0-4e0c-9ccc-67f73fddd8e9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:33.598992 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-b415c6bd-e8e0-4e0c-9ccc-67f73fddd8e9 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1722 microversion: 2.20 time: 0.158808 May 16 17:49:33.599565 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 448/876] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:33 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:34.618483 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e5795683-6917-419c-8586-8b8b72c2f0ad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:34.619216 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e5795683-6917-419c-8586-8b8b72c2f0ad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:34.626488 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e5795683-6917-419c-8586-8b8b72c2f0ad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:34.626959 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e5795683-6917-419c-8586-8b8b72c2f0ad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:34.627747 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e5795683-6917-419c-8586-8b8b72c2f0ad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:34.628203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e5795683-6917-419c-8586-8b8b72c2f0ad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:34.762623 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e5795683-6917-419c-8586-8b8b72c2f0ad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:34.770763 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e5795683-6917-419c-8586-8b8b72c2f0ad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:34.772356 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e5795683-6917-419c-8586-8b8b72c2f0ad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:34.773507 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e5795683-6917-419c-8586-8b8b72c2f0ad tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1722 microversion: 2.20 time: 0.159653 May 16 17:49:34.774176 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 429/877] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:34 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:35.796552 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-642ad021-bee5-45c6-85cc-feeb839a94d2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:35.797581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-642ad021-bee5-45c6-85cc-feeb839a94d2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:35.807900 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-642ad021-bee5-45c6-85cc-feeb839a94d2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:35.808829 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-642ad021-bee5-45c6-85cc-feeb839a94d2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:35.810105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-642ad021-bee5-45c6-85cc-feeb839a94d2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:35.810835 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-642ad021-bee5-45c6-85cc-feeb839a94d2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:35.948030 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-642ad021-bee5-45c6-85cc-feeb839a94d2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:35.961427 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-642ad021-bee5-45c6-85cc-feeb839a94d2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:35.963977 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-642ad021-bee5-45c6-85cc-feeb839a94d2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:35.965900 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-642ad021-bee5-45c6-85cc-feeb839a94d2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1665 microversion: 2.20 time: 0.175772 May 16 17:49:35.966815 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 449/878] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:35 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1665 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:35.985051 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c8c84df0-644d-480c-8fd1-1229561064f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4093f0ac-64ac-407c-9382-40e9d645a967"}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:49:35.986222 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-c8c84df0-644d-480c-8fd1-1229561064f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:35.992899 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c8c84df0-644d-480c-8fd1-1229561064f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:35.993346 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c8c84df0-644d-480c-8fd1-1229561064f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:35.994142 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c8c84df0-644d-480c-8fd1-1229561064f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:35.994573 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c8c84df0-644d-480c-8fd1-1229561064f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:36.289192 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-c8c84df0-644d-480c-8fd1-1229561064f2 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "POST /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308108 May 16 17:49:36.289904 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 430/879] 10.222.0.58 () {62 vars in 1363 bytes} [Mon May 16 17:49:35 2022] POST /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07/os-volume_attachments => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 17:49:36.412234 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ff2a42da-98b0-4392-a406-529a5d502916 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:36.413149 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ff2a42da-98b0-4392-a406-529a5d502916 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:36.419587 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ff2a42da-98b0-4392-a406-529a5d502916 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:36.420041 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ff2a42da-98b0-4392-a406-529a5d502916 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:36.420812 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ff2a42da-98b0-4392-a406-529a5d502916 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:36.421248 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ff2a42da-98b0-4392-a406-529a5d502916 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:36.658553 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ff2a42da-98b0-4392-a406-529a5d502916 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07/os-volume_attachments/4093f0ac-64ac-407c-9382-40e9d645a967" status: 202 len: 0 microversion: 2.20 time: 0.250327 May 16 17:49:36.659135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 450/880] 10.222.0.58 () {60 vars in 1456 bytes} [Mon May 16 17:49:36 2022] DELETE /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07/os-volume_attachments/4093f0ac-64ac-407c-9382-40e9d645a967 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 17:49:36.705374 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-3b8947fb-a979-4406-8e99-882db611b037 req-83e519bd-d719-4ab2-9206-5e8b6cd37d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d18297-c3bf-4b67-b775-1121be87da07", "name": "network-vif-unplugged", "status": "completed", "tag": "82d9ed45-eecf-4842-8a43-0e5549e8b8a9"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:49:36.714904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-752a2dc7-4c6e-482d-af54-662d4ca4f51a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:49:36.715269 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-3b8947fb-a979-4406-8e99-882db611b037 req-83e519bd-d719-4ab2-9206-5e8b6cd37d25 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:36.715492 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-752a2dc7-4c6e-482d-af54-662d4ca4f51a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:36.715922 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-3b8947fb-a979-4406-8e99-882db611b037 req-83e519bd-d719-4ab2-9206-5e8b6cd37d25 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:36.723751 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-752a2dc7-4c6e-482d-af54-662d4ca4f51a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:36.724225 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-752a2dc7-4c6e-482d-af54-662d4ca4f51a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:36.725078 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-752a2dc7-4c6e-482d-af54-662d4ca4f51a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:36.725525 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-752a2dc7-4c6e-482d-af54-662d4ca4f51a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:36.727789 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.compute.server_external_events [req-3b8947fb-a979-4406-8e99-882db611b037 req-83e519bd-d719-4ab2-9206-5e8b6cd37d25 service nova] Unable to find a host for instance a9d18297-c3bf-4b67-b775-1121be87da07. Dropping event network-vif-unplugged {{(pid=128816) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 16 17:49:36.728696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-3b8947fb-a979-4406-8e99-882db611b037 req-83e519bd-d719-4ab2-9206-5e8b6cd37d25 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027336 May 16 17:49:36.729297 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 431/881] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 16 17:49:36.808231 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-752a2dc7-4c6e-482d-af54-662d4ca4f51a tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "POST /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07/action" status: 202 len: 0 microversion: 2.20 time: 0.097485 May 16 17:49:36.808756 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 451/882] 10.222.0.58 () {62 vars in 1318 bytes} [Mon May 16 17:49:36 2022] POST /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 16 17:49:36.817238 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-dde916ea-cbe2-442d-a538-0200b4cba6c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:36.817951 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-dde916ea-cbe2-442d-a538-0200b4cba6c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:36.824095 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-dde916ea-cbe2-442d-a538-0200b4cba6c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:36.824550 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-dde916ea-cbe2-442d-a538-0200b4cba6c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:36.825425 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-dde916ea-cbe2-442d-a538-0200b4cba6c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:36.825861 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-dde916ea-cbe2-442d-a538-0200b4cba6c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:36.958814 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-dde916ea-cbe2-442d-a538-0200b4cba6c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:36.966553 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-dde916ea-cbe2-442d-a538-0200b4cba6c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:36.968020 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-dde916ea-cbe2-442d-a538-0200b4cba6c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:36.969161 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-dde916ea-cbe2-442d-a538-0200b4cba6c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1673 microversion: 2.20 time: 0.156039 May 16 17:49:36.969984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 432/883] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:36 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:37.988250 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-b243d9b6-b951-4848-9af4-c65a0cac2151 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:37.988856 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b243d9b6-b951-4848-9af4-c65a0cac2151 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:37.996305 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b243d9b6-b951-4848-9af4-c65a0cac2151 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:37.996757 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b243d9b6-b951-4848-9af4-c65a0cac2151 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:37.997532 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b243d9b6-b951-4848-9af4-c65a0cac2151 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:37.998026 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b243d9b6-b951-4848-9af4-c65a0cac2151 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:38.197266 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b243d9b6-b951-4848-9af4-c65a0cac2151 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:38.206032 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b243d9b6-b951-4848-9af4-c65a0cac2151 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:38.207852 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b243d9b6-b951-4848-9af4-c65a0cac2151 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:38.208977 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-b243d9b6-b951-4848-9af4-c65a0cac2151 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1731 microversion: 2.20 time: 0.225381 May 16 17:49:38.209576 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 452/884] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:37 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1731 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:39.230012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9b477d30-7fa5-4650-8182-d7e2f016fb5c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:39.231314 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-9b477d30-7fa5-4650-8182-d7e2f016fb5c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:39.237984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9b477d30-7fa5-4650-8182-d7e2f016fb5c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:39.238429 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9b477d30-7fa5-4650-8182-d7e2f016fb5c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:39.239197 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9b477d30-7fa5-4650-8182-d7e2f016fb5c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:39.239620 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9b477d30-7fa5-4650-8182-d7e2f016fb5c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:39.374326 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9b477d30-7fa5-4650-8182-d7e2f016fb5c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:39.382446 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9b477d30-7fa5-4650-8182-d7e2f016fb5c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:39.383929 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9b477d30-7fa5-4650-8182-d7e2f016fb5c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:39.385076 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-9b477d30-7fa5-4650-8182-d7e2f016fb5c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1731 microversion: 2.20 time: 0.160148 May 16 17:49:39.385836 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 433/885] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:39 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:40.406758 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4b9530ba-c5a0-4926-b93f-f6ab71b2a8af tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:40.408300 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-4b9530ba-c5a0-4926-b93f-f6ab71b2a8af tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:40.417507 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4b9530ba-c5a0-4926-b93f-f6ab71b2a8af tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:40.417989 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4b9530ba-c5a0-4926-b93f-f6ab71b2a8af tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:40.418774 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4b9530ba-c5a0-4926-b93f-f6ab71b2a8af tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:40.419209 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4b9530ba-c5a0-4926-b93f-f6ab71b2a8af tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:40.561943 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-4b9530ba-c5a0-4926-b93f-f6ab71b2a8af tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:40.570868 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-4b9530ba-c5a0-4926-b93f-f6ab71b2a8af tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:40.572378 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-4b9530ba-c5a0-4926-b93f-f6ab71b2a8af tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:40.573596 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-4b9530ba-c5a0-4926-b93f-f6ab71b2a8af tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1731 microversion: 2.20 time: 0.172236 May 16 17:49:40.578063 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 453/886] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:40 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:41.591906 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d14a64ed-d9c8-456e-a468-00a48bd60939 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:41.592508 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d14a64ed-d9c8-456e-a468-00a48bd60939 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:41.599554 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d14a64ed-d9c8-456e-a468-00a48bd60939 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:41.600067 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d14a64ed-d9c8-456e-a468-00a48bd60939 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:41.600899 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d14a64ed-d9c8-456e-a468-00a48bd60939 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:41.601388 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d14a64ed-d9c8-456e-a468-00a48bd60939 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:41.743671 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d14a64ed-d9c8-456e-a468-00a48bd60939 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:41.752332 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d14a64ed-d9c8-456e-a468-00a48bd60939 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:41.754157 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d14a64ed-d9c8-456e-a468-00a48bd60939 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:41.755346 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d14a64ed-d9c8-456e-a468-00a48bd60939 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1731 microversion: 2.20 time: 0.167329 May 16 17:49:41.756259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 434/887] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:41 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:42.773771 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e5f5775d-d2cb-4393-a313-da4078c13564 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:42.774393 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-e5f5775d-d2cb-4393-a313-da4078c13564 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:42.781435 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e5f5775d-d2cb-4393-a313-da4078c13564 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:42.781905 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e5f5775d-d2cb-4393-a313-da4078c13564 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:42.782672 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e5f5775d-d2cb-4393-a313-da4078c13564 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:42.783098 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e5f5775d-d2cb-4393-a313-da4078c13564 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:42.920477 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-e5f5775d-d2cb-4393-a313-da4078c13564 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:42.929372 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-e5f5775d-d2cb-4393-a313-da4078c13564 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:42.930972 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-e5f5775d-d2cb-4393-a313-da4078c13564 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:42.932234 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-e5f5775d-d2cb-4393-a313-da4078c13564 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1731 microversion: 2.20 time: 0.162373 May 16 17:49:42.933088 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 454/888] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:42 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:43.952241 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e048d5d7-6683-4bb6-a2d8-bfc1abacc679 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:43.952839 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e048d5d7-6683-4bb6-a2d8-bfc1abacc679 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:43.959402 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e048d5d7-6683-4bb6-a2d8-bfc1abacc679 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:43.959861 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e048d5d7-6683-4bb6-a2d8-bfc1abacc679 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:43.960749 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e048d5d7-6683-4bb6-a2d8-bfc1abacc679 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:43.961289 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e048d5d7-6683-4bb6-a2d8-bfc1abacc679 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:44.278926 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e048d5d7-6683-4bb6-a2d8-bfc1abacc679 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:44.287501 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e048d5d7-6683-4bb6-a2d8-bfc1abacc679 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:44.289308 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e048d5d7-6683-4bb6-a2d8-bfc1abacc679 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:44.290499 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e048d5d7-6683-4bb6-a2d8-bfc1abacc679 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1731 microversion: 2.20 time: 0.342312 May 16 17:49:44.291254 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 435/889] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:43 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1731 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:45.309841 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-087ab525-ffa0-4d9d-92e8-8db286fa1bba tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:45.310722 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-087ab525-ffa0-4d9d-92e8-8db286fa1bba tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:45.317696 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-087ab525-ffa0-4d9d-92e8-8db286fa1bba tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:45.318147 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-087ab525-ffa0-4d9d-92e8-8db286fa1bba tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:45.318919 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-087ab525-ffa0-4d9d-92e8-8db286fa1bba tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:45.319357 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-087ab525-ffa0-4d9d-92e8-8db286fa1bba tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:45.463334 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-087ab525-ffa0-4d9d-92e8-8db286fa1bba tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:45.472095 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-087ab525-ffa0-4d9d-92e8-8db286fa1bba tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:45.473599 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-087ab525-ffa0-4d9d-92e8-8db286fa1bba tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:45.474766 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-087ab525-ffa0-4d9d-92e8-8db286fa1bba tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1731 microversion: 2.20 time: 0.169136 May 16 17:49:45.475364 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 455/890] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:45 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:46.498216 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-acc99a03-6797-4651-8924-c56d339707e7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:46.499307 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-acc99a03-6797-4651-8924-c56d339707e7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:46.506947 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-acc99a03-6797-4651-8924-c56d339707e7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:46.507398 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-acc99a03-6797-4651-8924-c56d339707e7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:46.508161 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-acc99a03-6797-4651-8924-c56d339707e7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:46.508597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-acc99a03-6797-4651-8924-c56d339707e7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:46.656677 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-acc99a03-6797-4651-8924-c56d339707e7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:46.666936 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-acc99a03-6797-4651-8924-c56d339707e7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:46.668432 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-acc99a03-6797-4651-8924-c56d339707e7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:46.669582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-acc99a03-6797-4651-8924-c56d339707e7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1731 microversion: 2.20 time: 0.178276 May 16 17:49:46.670169 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 436/891] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:46 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:47.692263 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0196ff6c-9839-4acd-b128-ae58e783503c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:47.693256 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-0196ff6c-9839-4acd-b128-ae58e783503c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:47.703966 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0196ff6c-9839-4acd-b128-ae58e783503c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:47.704730 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0196ff6c-9839-4acd-b128-ae58e783503c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:47.706060 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0196ff6c-9839-4acd-b128-ae58e783503c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:47.706792 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0196ff6c-9839-4acd-b128-ae58e783503c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:47.840213 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-0196ff6c-9839-4acd-b128-ae58e783503c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:47.848413 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-0196ff6c-9839-4acd-b128-ae58e783503c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:47.849941 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-0196ff6c-9839-4acd-b128-ae58e783503c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:47.851098 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-0196ff6c-9839-4acd-b128-ae58e783503c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1731 microversion: 2.20 time: 0.165696 May 16 17:49:47.851643 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 456/892] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:47 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:48.870272 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e4fcb71e-474c-4484-b791-7631e8362931 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:48.871215 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e4fcb71e-474c-4484-b791-7631e8362931 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:48.882052 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e4fcb71e-474c-4484-b791-7631e8362931 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:48.882777 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e4fcb71e-474c-4484-b791-7631e8362931 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:48.884033 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e4fcb71e-474c-4484-b791-7631e8362931 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:48.884731 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e4fcb71e-474c-4484-b791-7631e8362931 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:49.040121 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e4fcb71e-474c-4484-b791-7631e8362931 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:49.048725 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e4fcb71e-474c-4484-b791-7631e8362931 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:49.050264 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e4fcb71e-474c-4484-b791-7631e8362931 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:49.051411 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e4fcb71e-474c-4484-b791-7631e8362931 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1731 microversion: 2.20 time: 0.185912 May 16 17:49:49.051935 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 437/893] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:48 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:50.079499 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-691507be-62e9-413f-9c8e-22c35a521750 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:50.080504 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-691507be-62e9-413f-9c8e-22c35a521750 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:50.091410 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-691507be-62e9-413f-9c8e-22c35a521750 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:50.092162 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-691507be-62e9-413f-9c8e-22c35a521750 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:50.093433 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-691507be-62e9-413f-9c8e-22c35a521750 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:50.094185 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-691507be-62e9-413f-9c8e-22c35a521750 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:50.240297 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-691507be-62e9-413f-9c8e-22c35a521750 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:50.248369 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-691507be-62e9-413f-9c8e-22c35a521750 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:50.249875 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-691507be-62e9-413f-9c8e-22c35a521750 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:50.251015 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-691507be-62e9-413f-9c8e-22c35a521750 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1731 microversion: 2.20 time: 0.178072 May 16 17:49:50.251574 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 457/894] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:50 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:51.271039 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d07a02f8-6e89-484f-a4a7-9a218e8dc05d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:51.271639 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d07a02f8-6e89-484f-a4a7-9a218e8dc05d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:51.278695 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d07a02f8-6e89-484f-a4a7-9a218e8dc05d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:51.279149 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d07a02f8-6e89-484f-a4a7-9a218e8dc05d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:51.279919 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d07a02f8-6e89-484f-a4a7-9a218e8dc05d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:51.280355 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d07a02f8-6e89-484f-a4a7-9a218e8dc05d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:51.409744 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d07a02f8-6e89-484f-a4a7-9a218e8dc05d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:51.418033 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d07a02f8-6e89-484f-a4a7-9a218e8dc05d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:51.419518 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d07a02f8-6e89-484f-a4a7-9a218e8dc05d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:51.420661 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d07a02f8-6e89-484f-a4a7-9a218e8dc05d tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1731 microversion: 2.20 time: 0.153839 May 16 17:49:51.421215 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 438/895] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:51 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:52.447954 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-ee04c4e5-3329-4cea-85b5-e94f11231717 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:52.448690 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-ee04c4e5-3329-4cea-85b5-e94f11231717 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:52.456786 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ee04c4e5-3329-4cea-85b5-e94f11231717 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:52.457239 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ee04c4e5-3329-4cea-85b5-e94f11231717 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:52.458037 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ee04c4e5-3329-4cea-85b5-e94f11231717 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:52.458470 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-ee04c4e5-3329-4cea-85b5-e94f11231717 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:52.601306 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ee04c4e5-3329-4cea-85b5-e94f11231717 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:52.613381 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ee04c4e5-3329-4cea-85b5-e94f11231717 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:52.614911 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-ee04c4e5-3329-4cea-85b5-e94f11231717 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:52.616062 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-ee04c4e5-3329-4cea-85b5-e94f11231717 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1731 microversion: 2.20 time: 0.173028 May 16 17:49:52.616636 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 458/896] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:52 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:52.803385 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-163375e2-b0cd-4f75-a071-26d6b715dd03 req-35fef75c-4f23-4c2c-9090-2cb4e3153188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d18297-c3bf-4b67-b775-1121be87da07", "name": "network-vif-plugged", "status": "completed", "tag": "82d9ed45-eecf-4842-8a43-0e5549e8b8a9"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:49:52.812273 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-163375e2-b0cd-4f75-a071-26d6b715dd03 req-35fef75c-4f23-4c2c-9090-2cb4e3153188 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:52.812705 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-163375e2-b0cd-4f75-a071-26d6b715dd03 req-35fef75c-4f23-4c2c-9090-2cb4e3153188 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:52.823832 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-163375e2-b0cd-4f75-a071-26d6b715dd03 req-35fef75c-4f23-4c2c-9090-2cb4e3153188 service nova] Creating event network-vif-plugged:82d9ed45-eecf-4842-8a43-0e5549e8b8a9 for instance a9d18297-c3bf-4b67-b775-1121be87da07 on hv-cinder-83769 May 16 17:49:52.828987 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-163375e2-b0cd-4f75-a071-26d6b715dd03 req-35fef75c-4f23-4c2c-9090-2cb4e3153188 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029368 May 16 17:49:52.829580 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 439/897] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:49:53.636970 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d715a804-d160-4a5e-8545-7313ede482cf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:53.637600 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d715a804-d160-4a5e-8545-7313ede482cf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:53.647622 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d715a804-d160-4a5e-8545-7313ede482cf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:53.648308 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d715a804-d160-4a5e-8545-7313ede482cf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:53.649494 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d715a804-d160-4a5e-8545-7313ede482cf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:53.650082 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d715a804-d160-4a5e-8545-7313ede482cf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:53.792064 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d715a804-d160-4a5e-8545-7313ede482cf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:53.800628 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d715a804-d160-4a5e-8545-7313ede482cf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:53.802179 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d715a804-d160-4a5e-8545-7313ede482cf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:53.803354 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d715a804-d160-4a5e-8545-7313ede482cf tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1731 microversion: 2.20 time: 0.172762 May 16 17:49:53.804003 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 459/898] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:53 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:49:54.825587 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-23bdd7cb-5fc9-461a-9f48-2237de72fdfa tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:49:54.826337 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-23bdd7cb-5fc9-461a-9f48-2237de72fdfa tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:49:54.834259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-23bdd7cb-5fc9-461a-9f48-2237de72fdfa tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:54.834704 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-23bdd7cb-5fc9-461a-9f48-2237de72fdfa tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:54.835462 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-23bdd7cb-5fc9-461a-9f48-2237de72fdfa tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:49:54.835895 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-23bdd7cb-5fc9-461a-9f48-2237de72fdfa tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:49:55.023526 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-23bdd7cb-5fc9-461a-9f48-2237de72fdfa tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:55.035984 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-23bdd7cb-5fc9-461a-9f48-2237de72fdfa tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:55.038590 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-23bdd7cb-5fc9-461a-9f48-2237de72fdfa tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:49:55.040363 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-23bdd7cb-5fc9-461a-9f48-2237de72fdfa tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1718 microversion: 2.20 time: 0.222297 May 16 17:49:55.041148 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 440/899] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:49:54 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1718 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:50:28.061090 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-55a76866-80ab-440a-87d2-8b0d0719de4e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:28.062125 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-55a76866-80ab-440a-87d2-8b0d0719de4e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:28.068510 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55a76866-80ab-440a-87d2-8b0d0719de4e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:28.068965 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55a76866-80ab-440a-87d2-8b0d0719de4e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:28.069776 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55a76866-80ab-440a-87d2-8b0d0719de4e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:28.070217 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55a76866-80ab-440a-87d2-8b0d0719de4e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:28.101144 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-55a76866-80ab-440a-87d2-8b0d0719de4e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044458 May 16 17:50:28.101718 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 460/900] 10.222.0.58 () {60 vars in 1342 bytes} [Mon May 16 17:50:28 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:28.160942 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a61fadc6-4cf9-4d21-956b-f77d6f16e93f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:28.161476 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a61fadc6-4cf9-4d21-956b-f77d6f16e93f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:28.168543 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a61fadc6-4cf9-4d21-956b-f77d6f16e93f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:28.169000 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a61fadc6-4cf9-4d21-956b-f77d6f16e93f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:28.169809 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a61fadc6-4cf9-4d21-956b-f77d6f16e93f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:28.170244 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a61fadc6-4cf9-4d21-956b-f77d6f16e93f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:28.198005 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a61fadc6-4cf9-4d21-956b-f77d6f16e93f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Going to try to terminate instance {{(pid=128816) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:50:28.282372 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a61fadc6-4cf9-4d21-956b-f77d6f16e93f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 204 len: 0 microversion: 2.20 time: 0.125716 May 16 17:50:28.283418 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 441/901] 10.222.0.58 () {60 vars in 1279 bytes} [Mon May 16 17:50:28 2022] DELETE /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 17:50:28.291686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-82a9b13c-d0c8-4632-81a0-c10bfa53ef26 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:28.292348 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-82a9b13c-d0c8-4632-81a0-c10bfa53ef26 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:28.298703 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-82a9b13c-d0c8-4632-81a0-c10bfa53ef26 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:28.299152 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-82a9b13c-d0c8-4632-81a0-c10bfa53ef26 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:28.299919 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-82a9b13c-d0c8-4632-81a0-c10bfa53ef26 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:28.300353 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-82a9b13c-d0c8-4632-81a0-c10bfa53ef26 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:28.483217 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-82a9b13c-d0c8-4632-81a0-c10bfa53ef26 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:28.491458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-82a9b13c-d0c8-4632-81a0-c10bfa53ef26 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:28.492965 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-82a9b13c-d0c8-4632-81a0-c10bfa53ef26 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:28.494112 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-82a9b13c-d0c8-4632-81a0-c10bfa53ef26 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1724 microversion: 2.20 time: 0.206648 May 16 17:50:28.494661 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 461/902] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:50:28 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 17:50:29.513580 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-001d621c-b9db-4bde-aef2-44e68e03de2c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:29.514278 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-001d621c-b9db-4bde-aef2-44e68e03de2c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:29.521962 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-001d621c-b9db-4bde-aef2-44e68e03de2c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:29.522523 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-001d621c-b9db-4bde-aef2-44e68e03de2c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:29.523303 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-001d621c-b9db-4bde-aef2-44e68e03de2c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:29.523740 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-001d621c-b9db-4bde-aef2-44e68e03de2c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:29.726901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-001d621c-b9db-4bde-aef2-44e68e03de2c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:29.736093 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-001d621c-b9db-4bde-aef2-44e68e03de2c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:29.737823 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-001d621c-b9db-4bde-aef2-44e68e03de2c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:29.739689 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-001d621c-b9db-4bde-aef2-44e68e03de2c tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1724 microversion: 2.20 time: 0.230240 May 16 17:50:29.740214 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 442/903] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:50:29 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:50:30.535537 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-44e1dd68-abc5-4f7f-8ed1-6a2110e36f72 req-1fc1f22e-2385-44e9-b53d-3ca8c5734963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d18297-c3bf-4b67-b775-1121be87da07", "name": "network-vif-deleted", "tag": "82d9ed45-eecf-4842-8a43-0e5549e8b8a9"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:50:30.544396 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-44e1dd68-abc5-4f7f-8ed1-6a2110e36f72 req-1fc1f22e-2385-44e9-b53d-3ca8c5734963 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:30.544838 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-44e1dd68-abc5-4f7f-8ed1-6a2110e36f72 req-1fc1f22e-2385-44e9-b53d-3ca8c5734963 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:30.558097 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-44e1dd68-abc5-4f7f-8ed1-6a2110e36f72 req-1fc1f22e-2385-44e9-b53d-3ca8c5734963 service nova] Creating event network-vif-deleted:82d9ed45-eecf-4842-8a43-0e5549e8b8a9 for instance a9d18297-c3bf-4b67-b775-1121be87da07 on hv-cinder-83769 May 16 17:50:30.565809 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-44e1dd68-abc5-4f7f-8ed1-6a2110e36f72 req-1fc1f22e-2385-44e9-b53d-3ca8c5734963 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096539 May 16 17:50:30.573609 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 462/904] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:50:30.758548 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e0b84157-aae7-4c6b-9cdd-144ecca5b5c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:30.759173 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e0b84157-aae7-4c6b-9cdd-144ecca5b5c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:30.765479 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e0b84157-aae7-4c6b-9cdd-144ecca5b5c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:30.765959 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e0b84157-aae7-4c6b-9cdd-144ecca5b5c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:30.766789 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e0b84157-aae7-4c6b-9cdd-144ecca5b5c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:30.767161 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e0b84157-aae7-4c6b-9cdd-144ecca5b5c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:30.798046 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e0b84157-aae7-4c6b-9cdd-144ecca5b5c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:30.798528 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e0b84157-aae7-4c6b-9cdd-144ecca5b5c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:30.798917 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-e0b84157-aae7-4c6b-9cdd-144ecca5b5c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lazy-loading 'fault' on Instance uuid a9d18297-c3bf-4b67-b775-1121be87da07 {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:50:30.841707 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e0b84157-aae7-4c6b-9cdd-144ecca5b5c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:30.849677 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e0b84157-aae7-4c6b-9cdd-144ecca5b5c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:30.851235 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e0b84157-aae7-4c6b-9cdd-144ecca5b5c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1ddee42951b4de98dea071f2b7a9958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b218f6b53844d828be7b8c5de1cde67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:30.852558 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e0b84157-aae7-4c6b-9cdd-144ecca5b5c8 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 200 len: 1371 microversion: 2.20 time: 0.098086 May 16 17:50:30.853109 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 443/905] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:50:30 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 17:50:31.876714 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-18e2d503-1eb7-4db7-898b-65c28c9c8213 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:31.877940 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-18e2d503-1eb7-4db7-898b-65c28c9c8213 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:31.888466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-18e2d503-1eb7-4db7-898b-65c28c9c8213 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:31.889220 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-18e2d503-1eb7-4db7-898b-65c28c9c8213 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:31.890544 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-18e2d503-1eb7-4db7-898b-65c28c9c8213 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:31.891271 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-18e2d503-1eb7-4db7-898b-65c28c9c8213 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:31.907564 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-18e2d503-1eb7-4db7-898b-65c28c9c8213 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] HTTP exception thrown: Instance a9d18297-c3bf-4b67-b775-1121be87da07 could not be found. May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-18e2d503-1eb7-4db7-898b-65c28c9c8213 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Request method failure captured: May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 HTTP/1.1 May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigo3Bgf2DaHqLnAhXH8JGptB3QGFYfmrdCuGd8A27MytEun23d7VVPf3JJRUJvUv1GEV3-meqp17DpZGEi5ZM8ujMcljqrLw9zS7Fkods3zs6Y9IYWksEDbG-JhaCclRzWM2bg5MLBPzyHbWF3H6cMlmK8N2IXl0MJJNoJgbPCrqjML8 May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Openstack-Nova-Api-Version: 2.20 May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 8b218f6b53844d828be7b8c5de1cde67 May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1201041881 May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:50:31.909222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:50:31.910953 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b218f6b53844d828be7b8c5de1cde67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8b218f6b53844d828be7b8c5de1cde67", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8b218f6b53844d828be7b8c5de1cde67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b218f6b53844d828be7b8c5de1cde67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:50:31.910953 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1201041881 May 16 17:50:31.910953 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 8b218f6b53844d828be7b8c5de1cde67 May 16 17:50:31.910953 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1201041881 May 16 17:50:31.910953 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-AttachVolumeShelveTestJSON-1201041881-project May 16 17:50:31.910953 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:50:31.910953 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:50:31.910953 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: e1ddee42951b4de98dea071f2b7a9958 May 16 17:50:31.910953 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1201041881-project May 16 17:50:31.910953 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:50:31.910953 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance a9d18297-c3bf-4b67-b775-1121be87da07 could not be found. May 16 17:50:31.910953 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': 'a9d18297-c3bf-4b67-b775-1121be87da07'} May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9d18297-c3bf-4b67-b775-1121be87da07 could not be found. May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:50:31.911904 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:50:31.913466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:50:31.913466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:50:31.913466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:50:31.913466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:50:31.913466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:50:31.913466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:50:31.913466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:50:31.913466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9d18297-c3bf-4b67-b775-1121be87da07 could not be found. May 16 17:50:31.913466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:31.913466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:50:31.913466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:31.913466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:50:31.913466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:50:31.913466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:50:31.913466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:50:31.913466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:50:31.913466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9d18297-c3bf-4b67-b775-1121be87da07 could not be found. May 16 17:50:31.913466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:31.915213 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-18e2d503-1eb7-4db7-898b-65c28c9c8213 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Returning 404 to user: Instance a9d18297-c3bf-4b67-b775-1121be87da07 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:50:31.915213 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-18e2d503-1eb7-4db7-898b-65c28c9c8213 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 404 len: 111 microversion: 2.20 time: 0.041845 May 16 17:50:31.915213 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 463/906] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:50:31 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 17:50:31.922455 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-7b91956a-184b-4987-be33-669543b8a331 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '.version_select at 0x7f79a4773040>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:31.943484 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-7b91956a-184b-4987-be33-669543b8a331 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1892317308" status: 204 len: 0 microversion: 2.20 time: 0.027188 May 16 17:50:31.944032 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 444/907] 10.222.0.58 () {60 vars in 1261 bytes} [Mon May 16 17:50:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1892317308 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 17:50:33.736315 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0f2248ed-bc44-4dba-be27-ca733f1a1b7f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:33.736882 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-0f2248ed-bc44-4dba-be27-ca733f1a1b7f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:33.746995 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0f2248ed-bc44-4dba-be27-ca733f1a1b7f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:33.747670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0f2248ed-bc44-4dba-be27-ca733f1a1b7f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:33.748857 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0f2248ed-bc44-4dba-be27-ca733f1a1b7f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:33.749474 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-0f2248ed-bc44-4dba-be27-ca733f1a1b7f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:33.765310 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-0f2248ed-bc44-4dba-be27-ca733f1a1b7f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] HTTP exception thrown: Instance a9d18297-c3bf-4b67-b775-1121be87da07 could not be found. May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0f2248ed-bc44-4dba-be27-ca733f1a1b7f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Request method failure captured: May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: DELETE /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 HTTP/1.1 May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigo3Bgf2DaHqLnAhXH8JGptB3QGFYfmrdCuGd8A27MytEun23d7VVPf3JJRUJvUv1GEV3-meqp17DpZGEi5ZM8ujMcljqrLw9zS7Fkods3zs6Y9IYWksEDbG-JhaCclRzWM2bg5MLBPzyHbWF3H6cMlmK8N2IXl0MJJNoJgbPCrqjML8 May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Openstack-Nova-Api-Version: 2.20 May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 8b218f6b53844d828be7b8c5de1cde67 May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1201041881 May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:50:33.766897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:50:33.768524 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b218f6b53844d828be7b8c5de1cde67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8b218f6b53844d828be7b8c5de1cde67", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8b218f6b53844d828be7b8c5de1cde67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b218f6b53844d828be7b8c5de1cde67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:50:33.768524 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1201041881 May 16 17:50:33.768524 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 8b218f6b53844d828be7b8c5de1cde67 May 16 17:50:33.768524 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1201041881 May 16 17:50:33.768524 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-AttachVolumeShelveTestJSON-1201041881-project May 16 17:50:33.768524 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:50:33.768524 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:50:33.768524 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: e1ddee42951b4de98dea071f2b7a9958 May 16 17:50:33.768524 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1201041881-project May 16 17:50:33.768524 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:50:33.768524 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance a9d18297-c3bf-4b67-b775-1121be87da07 could not be found. May 16 17:50:33.768524 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': 'a9d18297-c3bf-4b67-b775-1121be87da07'} May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9d18297-c3bf-4b67-b775-1121be87da07 could not be found. May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:50:33.769630 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9d18297-c3bf-4b67-b775-1121be87da07 could not be found. May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9d18297-c3bf-4b67-b775-1121be87da07 could not be found. May 16 17:50:33.771100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:33.772788 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-0f2248ed-bc44-4dba-be27-ca733f1a1b7f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Returning 404 to user: Instance a9d18297-c3bf-4b67-b775-1121be87da07 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:50:33.772788 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-0f2248ed-bc44-4dba-be27-ca733f1a1b7f tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 404 len: 111 microversion: 2.20 time: 0.037240 May 16 17:50:33.772788 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 464/908] 10.222.0.58 () {60 vars in 1279 bytes} [Mon May 16 17:50:33 2022] DELETE /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 17:50:33.777353 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-70bbd46f-913f-4480-a925-cfeaf2e647d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:33.778001 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-70bbd46f-913f-4480-a925-cfeaf2e647d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: a9d18297-c3bf-4b67-b775-1121be87da07] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:33.784885 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-70bbd46f-913f-4480-a925-cfeaf2e647d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:33.785328 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-70bbd46f-913f-4480-a925-cfeaf2e647d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:33.786125 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-70bbd46f-913f-4480-a925-cfeaf2e647d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:33.786553 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-70bbd46f-913f-4480-a925-cfeaf2e647d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:33.799925 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-70bbd46f-913f-4480-a925-cfeaf2e647d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] HTTP exception thrown: Instance a9d18297-c3bf-4b67-b775-1121be87da07 could not be found. May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-70bbd46f-913f-4480-a925-cfeaf2e647d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Request method failure captured: May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 HTTP/1.1 May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigo3Bgf2DaHqLnAhXH8JGptB3QGFYfmrdCuGd8A27MytEun23d7VVPf3JJRUJvUv1GEV3-meqp17DpZGEi5ZM8ujMcljqrLw9zS7Fkods3zs6Y9IYWksEDbG-JhaCclRzWM2bg5MLBPzyHbWF3H6cMlmK8N2IXl0MJJNoJgbPCrqjML8 May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Openstack-Nova-Api-Version: 2.20 May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 8b218f6b53844d828be7b8c5de1cde67 May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1201041881 May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:50:33.801542 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:50:33.803234 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b218f6b53844d828be7b8c5de1cde67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8b218f6b53844d828be7b8c5de1cde67", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8b218f6b53844d828be7b8c5de1cde67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b218f6b53844d828be7b8c5de1cde67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:50:33.803234 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1201041881 May 16 17:50:33.803234 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 8b218f6b53844d828be7b8c5de1cde67 May 16 17:50:33.803234 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1201041881 May 16 17:50:33.803234 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-AttachVolumeShelveTestJSON-1201041881-project May 16 17:50:33.803234 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:50:33.803234 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:50:33.803234 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: e1ddee42951b4de98dea071f2b7a9958 May 16 17:50:33.803234 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1201041881-project May 16 17:50:33.803234 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:50:33.803234 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance a9d18297-c3bf-4b67-b775-1121be87da07 could not be found. May 16 17:50:33.803234 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': 'a9d18297-c3bf-4b67-b775-1121be87da07'} May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9d18297-c3bf-4b67-b775-1121be87da07 could not be found. May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:50:33.804065 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:50:33.805294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:50:33.805294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:50:33.805294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:50:33.805294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:50:33.805294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:50:33.805294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:50:33.805294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:50:33.805294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9d18297-c3bf-4b67-b775-1121be87da07 could not be found. May 16 17:50:33.805294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:50:33.805294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:50:33.805294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:50:33.805294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:50:33.805294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:50:33.805294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:50:33.805294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:50:33.805294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:50:33.805294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9d18297-c3bf-4b67-b775-1121be87da07 could not be found. May 16 17:50:33.805294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:50:33.806555 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-70bbd46f-913f-4480-a925-cfeaf2e647d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Returning 404 to user: Instance a9d18297-c3bf-4b67-b775-1121be87da07 could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:50:33.806555 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-70bbd46f-913f-4480-a925-cfeaf2e647d7 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07" status: 404 len: 111 microversion: 2.20 time: 0.029965 May 16 17:50:33.806555 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 445/909] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:50:33 2022] GET /compute/v2.1/servers/a9d18297-c3bf-4b67-b775-1121be87da07 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 17:50:34.212312 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-582c7068-3163-422e-bb72-80c7d88269fb tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:34.212811 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-582c7068-3163-422e-bb72-80c7d88269fb tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:34.219348 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-582c7068-3163-422e-bb72-80c7d88269fb tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:34.219796 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-582c7068-3163-422e-bb72-80c7d88269fb tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:34.220571 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-582c7068-3163-422e-bb72-80c7d88269fb tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:34.221002 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-582c7068-3163-422e-bb72-80c7d88269fb tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:34.246288 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-582c7068-3163-422e-bb72-80c7d88269fb tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Going to try to terminate instance {{(pid=128815) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:50:34.328890 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-582c7068-3163-422e-bb72-80c7d88269fb tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 204 len: 0 microversion: 2.1 time: 0.120470 May 16 17:50:34.329566 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 465/910] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:50:34 2022] DELETE /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:50:34.338033 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ae194261-6cb2-480d-b415-558587532b53 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:34.338646 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-ae194261-6cb2-480d-b415-558587532b53 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:34.344540 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ae194261-6cb2-480d-b415-558587532b53 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:34.344989 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ae194261-6cb2-480d-b415-558587532b53 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:34.345795 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ae194261-6cb2-480d-b415-558587532b53 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:34.346235 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ae194261-6cb2-480d-b415-558587532b53 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:34.480051 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-ae194261-6cb2-480d-b415-558587532b53 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:34.488159 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ae194261-6cb2-480d-b415-558587532b53 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1578 microversion: 2.1 time: 0.154217 May 16 17:50:34.488721 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 446/911] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:34 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:34.947528 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e87dd9de-1d9a-486d-be24-009bc42f1583 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:34.948086 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-e87dd9de-1d9a-486d-be24-009bc42f1583 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:34.954614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e87dd9de-1d9a-486d-be24-009bc42f1583 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:34.955099 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e87dd9de-1d9a-486d-be24-009bc42f1583 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:34.955863 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e87dd9de-1d9a-486d-be24-009bc42f1583 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:34.956299 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e87dd9de-1d9a-486d-be24-009bc42f1583 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:34.974982 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-e87dd9de-1d9a-486d-be24-009bc42f1583 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] HTTP exception thrown: Instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e could not be found. May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e87dd9de-1d9a-486d-be24-009bc42f1583 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Request method failure captured: May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: DELETE /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e HTTP/1.1 May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigo3Bgf2DaHqLnAhXH8JGptB3QGFYfmrdCuGd8A27MytEun23d7VVPf3JJRUJvUv1GEV3-meqp17DpZGEi5ZM8ujMcljqrLw9zS7Fkods3zs6Y9IYWksEDbG-JhaCclRzWM2bg5MLBPzyHbWF3H6cMlmK8N2IXl0MJJNoJgbPCrqjML8 May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Openstack-Nova-Api-Version: 2.20 May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 8b218f6b53844d828be7b8c5de1cde67 May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1201041881 May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:50:34.976651 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:50:34.978376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b218f6b53844d828be7b8c5de1cde67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8b218f6b53844d828be7b8c5de1cde67", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8b218f6b53844d828be7b8c5de1cde67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b218f6b53844d828be7b8c5de1cde67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:50:34.978376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1201041881 May 16 17:50:34.978376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 8b218f6b53844d828be7b8c5de1cde67 May 16 17:50:34.978376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1201041881 May 16 17:50:34.978376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-AttachVolumeShelveTestJSON-1201041881-project May 16 17:50:34.978376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:50:34.978376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:50:34.978376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: e1ddee42951b4de98dea071f2b7a9958 May 16 17:50:34.978376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1201041881-project May 16 17:50:34.978376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:50:34.978376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e could not be found. May 16 17:50:34.978376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': '6dc200e3-53ea-4163-8472-0a5e8c70f07e'} May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e could not be found. May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:50:34.979164 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e could not be found. May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e could not be found. May 16 17:50:34.980563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:34.981828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e87dd9de-1d9a-486d-be24-009bc42f1583 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Returning 404 to user: Instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:50:34.981828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-e87dd9de-1d9a-486d-be24-009bc42f1583 tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 404 len: 111 microversion: 2.20 time: 0.035100 May 16 17:50:34.981828 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 466/912] 10.222.0.58 () {60 vars in 1279 bytes} [Mon May 16 17:50:34 2022] DELETE /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 17:50:34.988630 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-62b885ba-6e0d-49c4-94ae-23cfe28ff69e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:34.989235 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-62b885ba-6e0d-49c4-94ae-23cfe28ff69e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] [instance: 6dc200e3-53ea-4163-8472-0a5e8c70f07e] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:34.996043 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-62b885ba-6e0d-49c4-94ae-23cfe28ff69e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:34.996497 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-62b885ba-6e0d-49c4-94ae-23cfe28ff69e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:34.997264 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-62b885ba-6e0d-49c4-94ae-23cfe28ff69e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:34.997702 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-62b885ba-6e0d-49c4-94ae-23cfe28ff69e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:35.011009 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-62b885ba-6e0d-49c4-94ae-23cfe28ff69e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] HTTP exception thrown: Instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e could not be found. May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-62b885ba-6e0d-49c4-94ae-23cfe28ff69e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Request method failure captured: May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e HTTP/1.1 May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigo3Bgf2DaHqLnAhXH8JGptB3QGFYfmrdCuGd8A27MytEun23d7VVPf3JJRUJvUv1GEV3-meqp17DpZGEi5ZM8ujMcljqrLw9zS7Fkods3zs6Y9IYWksEDbG-JhaCclRzWM2bg5MLBPzyHbWF3H6cMlmK8N2IXl0MJJNoJgbPCrqjML8 May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Openstack-Nova-Api-Version: 2.20 May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 8b218f6b53844d828be7b8c5de1cde67 May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1201041881 May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:50:35.012582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:50:35.014353 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b218f6b53844d828be7b8c5de1cde67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8b218f6b53844d828be7b8c5de1cde67", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8b218f6b53844d828be7b8c5de1cde67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8b218f6b53844d828be7b8c5de1cde67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:50:35.014353 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1201041881 May 16 17:50:35.014353 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 8b218f6b53844d828be7b8c5de1cde67 May 16 17:50:35.014353 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1201041881 May 16 17:50:35.014353 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-AttachVolumeShelveTestJSON-1201041881-project May 16 17:50:35.014353 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:50:35.014353 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:50:35.014353 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: e1ddee42951b4de98dea071f2b7a9958 May 16 17:50:35.014353 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1201041881-project May 16 17:50:35.014353 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:50:35.014353 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e could not be found. May 16 17:50:35.014353 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': '6dc200e3-53ea-4163-8472-0a5e8c70f07e'} May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e could not be found. May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:50:35.018834 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:50:35.020571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:50:35.020571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:50:35.020571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:50:35.020571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:50:35.020571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:50:35.020571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:50:35.020571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:50:35.020571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e could not be found. May 16 17:50:35.020571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:50:35.020571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:50:35.020571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:50:35.020571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:50:35.020571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:50:35.020571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:50:35.020571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:50:35.020571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:50:35.020571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e could not be found. May 16 17:50:35.020571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:50:35.021949 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-62b885ba-6e0d-49c4-94ae-23cfe28ff69e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] Returning 404 to user: Instance 6dc200e3-53ea-4163-8472-0a5e8c70f07e could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:50:35.021949 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-62b885ba-6e0d-49c4-94ae-23cfe28ff69e tempest-AttachVolumeShelveTestJSON-1201041881 tempest-AttachVolumeShelveTestJSON-1201041881-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e" status: 404 len: 111 microversion: 2.20 time: 0.029387 May 16 17:50:35.021949 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 447/913] 10.222.0.58 () {60 vars in 1276 bytes} [Mon May 16 17:50:34 2022] GET /compute/v2.1/servers/6dc200e3-53ea-4163-8472-0a5e8c70f07e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 16 17:50:35.511293 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-08264ae2-306d-47d2-93f8-ee972716bbe7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:35.512133 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-08264ae2-306d-47d2-93f8-ee972716bbe7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:35.518750 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-08264ae2-306d-47d2-93f8-ee972716bbe7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:35.519205 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-08264ae2-306d-47d2-93f8-ee972716bbe7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:35.520014 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-08264ae2-306d-47d2-93f8-ee972716bbe7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:35.520451 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-08264ae2-306d-47d2-93f8-ee972716bbe7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:35.726409 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-08264ae2-306d-47d2-93f8-ee972716bbe7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:35.735577 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-08264ae2-306d-47d2-93f8-ee972716bbe7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1578 microversion: 2.1 time: 0.228213 May 16 17:50:35.736154 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 467/914] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:35 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1578 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:36.752506 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9ac8ab39-bfdc-4a9b-926f-b389e51cad0b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:36.753455 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-9ac8ab39-bfdc-4a9b-926f-b389e51cad0b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:36.760933 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9ac8ab39-bfdc-4a9b-926f-b389e51cad0b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:36.762650 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9ac8ab39-bfdc-4a9b-926f-b389e51cad0b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:36.763744 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9ac8ab39-bfdc-4a9b-926f-b389e51cad0b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:36.764059 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9ac8ab39-bfdc-4a9b-926f-b389e51cad0b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:36.844932 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9ac8ab39-bfdc-4a9b-926f-b389e51cad0b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:36.853264 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-9ac8ab39-bfdc-4a9b-926f-b389e51cad0b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1511 microversion: 2.1 time: 0.104757 May 16 17:50:36.853952 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 448/915] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:36 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1511 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:37.248675 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-5663a5cd-cf34-48f8-9148-45d78375d013 req-bcb4c600-8564-465e-8ba7-11ee08fc2a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9279a4c5-c764-46b4-8028-3bb0d8de0406", "name": "network-vif-deleted", "tag": "59abc649-1713-4a6f-b4af-005a342766ce"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:50:37.272346 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-5663a5cd-cf34-48f8-9148-45d78375d013 req-bcb4c600-8564-465e-8ba7-11ee08fc2a74 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:37.273825 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-5663a5cd-cf34-48f8-9148-45d78375d013 req-bcb4c600-8564-465e-8ba7-11ee08fc2a74 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:37.291105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-5663a5cd-cf34-48f8-9148-45d78375d013 req-bcb4c600-8564-465e-8ba7-11ee08fc2a74 service nova] Creating event network-vif-deleted:59abc649-1713-4a6f-b4af-005a342766ce for instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 on hv-cinder-83769 May 16 17:50:37.298319 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-5663a5cd-cf34-48f8-9148-45d78375d013 req-bcb4c600-8564-465e-8ba7-11ee08fc2a74 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057100 May 16 17:50:37.299387 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 468/916] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:50:37.871618 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-2dea896c-ea75-4327-a1b1-74c75c2ca638 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:37.872872 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-2dea896c-ea75-4327-a1b1-74c75c2ca638 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:37.880667 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2dea896c-ea75-4327-a1b1-74c75c2ca638 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:37.881500 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2dea896c-ea75-4327-a1b1-74c75c2ca638 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:37.882626 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2dea896c-ea75-4327-a1b1-74c75c2ca638 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:37.883279 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2dea896c-ea75-4327-a1b1-74c75c2ca638 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:37.920485 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2dea896c-ea75-4327-a1b1-74c75c2ca638 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:37.921107 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2dea896c-ea75-4327-a1b1-74c75c2ca638 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:37.922061 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-2dea896c-ea75-4327-a1b1-74c75c2ca638 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lazy-loading 'fault' on Instance uuid 9279a4c5-c764-46b4-8028-3bb0d8de0406 {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:50:37.979531 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-2dea896c-ea75-4327-a1b1-74c75c2ca638 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:37.987729 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-2dea896c-ea75-4327-a1b1-74c75c2ca638 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 200 len: 1184 microversion: 2.1 time: 0.120882 May 16 17:50:37.988307 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 449/917] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:37 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 1184 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:39.007054 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-15e735db-df0f-4832-a491-3952a78b65ed tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:39.008081 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-15e735db-df0f-4832-a491-3952a78b65ed tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:39.021968 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-15e735db-df0f-4832-a491-3952a78b65ed tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:39.021968 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-15e735db-df0f-4832-a491-3952a78b65ed tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:39.021968 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-15e735db-df0f-4832-a491-3952a78b65ed tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:39.022536 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-15e735db-df0f-4832-a491-3952a78b65ed tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:39.037520 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-15e735db-df0f-4832-a491-3952a78b65ed tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] HTTP exception thrown: Instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 could not be found. May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-15e735db-df0f-4832-a491-3952a78b65ed tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Request method failure captured: May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 HTTP/1.1 May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigo5IUEJBh6-I01HqPjDtxhWLhjRGKU3ZXXsmnpxGCO2smhgxS1eM5edD9p4-ZlTFOJBae5sbEyZVBPWhkl8Kez4G93D_BmH68SGG0ZXIxMeqboYkzyX7_RjpgWJbNP8cZTwoU6UNSOMx5JMVb057YF1169wO3Xwkv-v94lCIuQ4kB4s May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 782ab44dbedd4b94b6c8fb2414a51a79 May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-TestVolumeBootPattern-821215782 May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:50:39.040016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:50:39.041376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/782ab44dbedd4b94b6c8fb2414a51a79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_782ab44dbedd4b94b6c8fb2414a51a79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/782ab44dbedd4b94b6c8fb2414a51a79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/782ab44dbedd4b94b6c8fb2414a51a79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:50:39.041376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-TestVolumeBootPattern-821215782 May 16 17:50:39.041376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 782ab44dbedd4b94b6c8fb2414a51a79 May 16 17:50:39.041376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-TestVolumeBootPattern-821215782 May 16 17:50:39.041376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-TestVolumeBootPattern-821215782-project May 16 17:50:39.041376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:50:39.041376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:50:39.041376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: bb1a88c50d7f46e297e683e6c7ef033e May 16 17:50:39.041376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-TestVolumeBootPattern-821215782-project May 16 17:50:39.041376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:50:39.041376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 could not be found. May 16 17:50:39.041376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': '9279a4c5-c764-46b4-8028-3bb0d8de0406'} May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 could not be found. May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:50:39.042196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:50:39.043423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:50:39.043423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:50:39.043423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:50:39.043423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:50:39.043423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:50:39.043423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:50:39.043423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:50:39.043423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 could not be found. May 16 17:50:39.043423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:39.043423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:50:39.043423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:39.043423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:50:39.043423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:50:39.043423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:50:39.043423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:50:39.043423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:50:39.043423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 could not be found. May 16 17:50:39.043423 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:50:39.044645 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-15e735db-df0f-4832-a491-3952a78b65ed tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Returning 404 to user: Instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:50:39.044645 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-15e735db-df0f-4832-a491-3952a78b65ed tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 404 len: 111 microversion: 2.1 time: 0.038875 May 16 17:50:39.051167 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 469/918] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:39 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:50:39.114644 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-b714af7c-6770-4b31-9279-807bb1cea958 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-843821268", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1341442974", "security_groups": [{"name": "tempest-secgroup-smoke-941768447"}], "block_device_mapping_v2": [{"uuid": "de25aaa8-a327-4251-9c6f-a49d7b7dbdc5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "20304413-223e-468b-b381-be0770314d15"}]}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:50:39.233083 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.network.neutron [None req-b714af7c-6770-4b31-9279-807bb1cea958 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] validate_networks() for [('20304413-223e-468b-b381-be0770314d15', None, None, None, None, None)] {{(pid=128816) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:50:39.720755 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-b714af7c-6770-4b31-9279-807bb1cea958 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Flavor limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:50:39.721680 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-b714af7c-6770-4b31-9279-807bb1cea958 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Image limits 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:50:39.722694 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-b714af7c-6770-4b31-9279-807bb1cea958 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Flavor pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:50:39.723266 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-b714af7c-6770-4b31-9279-807bb1cea958 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Image pref 0:0:0 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:50:39.723850 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.virt.hardware [None req-b714af7c-6770-4b31-9279-807bb1cea958 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:50:39.735430 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b714af7c-6770-4b31-9279-807bb1cea958 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:39.735820 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b714af7c-6770-4b31-9279-807bb1cea958 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:39.736638 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b714af7c-6770-4b31-9279-807bb1cea958 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:39.737070 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-b714af7c-6770-4b31-9279-807bb1cea958 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:39.753603 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-b714af7c-6770-4b31-9279-807bb1cea958 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Getting quotas for project 782ab44dbedd4b94b6c8fb2414a51a79. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:50:39.757614 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-b714af7c-6770-4b31-9279-807bb1cea958 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Getting quotas for user bb1a88c50d7f46e297e683e6c7ef033e and project 782ab44dbedd4b94b6c8fb2414a51a79. Resources: {'instances', 'ram', 'cores'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:50:39.814983 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b714af7c-6770-4b31-9279-807bb1cea958 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Going to run 1 instances... {{(pid=128816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:50:39.817129 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-b714af7c-6770-4b31-9279-807bb1cea958 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de25aaa8-a327-4251-9c6f-a49d7b7dbdc5',volume_size=None,volume_type=None)] {{(pid=128816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:50:39.951745 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-b714af7c-6770-4b31-9279-807bb1cea958 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.854885 May 16 17:50:39.957276 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 450/919] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:50:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:50:39.963921 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-28c1a0d8-32e9-45ad-be35-37cb91a402ff tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:39.964731 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-28c1a0d8-32e9-45ad-be35-37cb91a402ff tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:40.037174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-28c1a0d8-32e9-45ad-be35-37cb91a402ff tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:40.046023 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-28c1a0d8-32e9-45ad-be35-37cb91a402ff tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 200 len: 1094 microversion: 2.1 time: 0.087124 May 16 17:50:40.055895 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 470/920] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:39 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 1094 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:41.065095 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4bc33814-7bf3-419e-b6a0-28691c789896 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:41.066550 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4bc33814-7bf3-419e-b6a0-28691c789896 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:41.082135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4bc33814-7bf3-419e-b6a0-28691c789896 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:41.082582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4bc33814-7bf3-419e-b6a0-28691c789896 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:41.083389 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4bc33814-7bf3-419e-b6a0-28691c789896 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:41.083825 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4bc33814-7bf3-419e-b6a0-28691c789896 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:41.170606 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-4bc33814-7bf3-419e-b6a0-28691c789896 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:41.179516 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4bc33814-7bf3-419e-b6a0-28691c789896 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 200 len: 1210 microversion: 2.1 time: 0.120591 May 16 17:50:41.180313 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 451/921] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:41 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 1210 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:42.196831 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-19550347-c079-4712-97ca-3a2cc9e12886 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:42.197513 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-19550347-c079-4712-97ca-3a2cc9e12886 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:42.205738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-19550347-c079-4712-97ca-3a2cc9e12886 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:42.206451 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-19550347-c079-4712-97ca-3a2cc9e12886 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:42.208079 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-19550347-c079-4712-97ca-3a2cc9e12886 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:42.208724 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-19550347-c079-4712-97ca-3a2cc9e12886 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:42.554458 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-19550347-c079-4712-97ca-3a2cc9e12886 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:42.562553 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-19550347-c079-4712-97ca-3a2cc9e12886 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 200 len: 1265 microversion: 2.1 time: 0.369723 May 16 17:50:42.563123 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 471/922] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:42 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 1265 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:43.172075 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-24daa0c0-fcf4-400e-b90a-71ba62b95b77 req-e6d08c6c-9d27-48a7-a77d-82e7d2aaa7bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8f1472-9a94-46a4-85ac-5570d0cf736c", "tag": "c880c8f6-9692-4951-8d4c-241bfc5f1099"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:50:43.205475 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-24daa0c0-fcf4-400e-b90a-71ba62b95b77 req-e6d08c6c-9d27-48a7-a77d-82e7d2aaa7bb service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:43.205942 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-24daa0c0-fcf4-400e-b90a-71ba62b95b77 req-e6d08c6c-9d27-48a7-a77d-82e7d2aaa7bb service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:43.225325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-24daa0c0-fcf4-400e-b90a-71ba62b95b77 req-e6d08c6c-9d27-48a7-a77d-82e7d2aaa7bb service nova] Creating event network-changed:c880c8f6-9692-4951-8d4c-241bfc5f1099 for instance 7a8f1472-9a94-46a4-85ac-5570d0cf736c on hv-cinder-83769 May 16 17:50:43.231772 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-24daa0c0-fcf4-400e-b90a-71ba62b95b77 req-e6d08c6c-9d27-48a7-a77d-82e7d2aaa7bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064427 May 16 17:50:43.232800 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 452/923] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 17:50:43.579682 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-a8999d83-464f-43eb-be40-f9633ab28a48 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:43.581074 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a8999d83-464f-43eb-be40-f9633ab28a48 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:43.588295 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a8999d83-464f-43eb-be40-f9633ab28a48 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:43.588957 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a8999d83-464f-43eb-be40-f9633ab28a48 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:43.590299 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a8999d83-464f-43eb-be40-f9633ab28a48 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:43.590910 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a8999d83-464f-43eb-be40-f9633ab28a48 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:43.844506 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-a8999d83-464f-43eb-be40-f9633ab28a48 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:43.852539 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-a8999d83-464f-43eb-be40-f9633ab28a48 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 200 len: 1265 microversion: 2.1 time: 0.276667 May 16 17:50:43.870030 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 472/924] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:43 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:44.876432 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-23966852-acc1-4789-b760-1f6912f37448 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:44.877106 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-23966852-acc1-4789-b760-1f6912f37448 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:44.883713 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-23966852-acc1-4789-b760-1f6912f37448 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:44.884163 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-23966852-acc1-4789-b760-1f6912f37448 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:44.885169 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-23966852-acc1-4789-b760-1f6912f37448 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:44.885799 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-23966852-acc1-4789-b760-1f6912f37448 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:44.946783 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4bc0fd8a-60f2-493a-b251-fd9030ad0a82 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Action: 'create', calling method: .version_select at 0x7f79a47feaf0>, body: {"keypair": {"name": "tempest-keypair-538510642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8Vj3LTn0xOImi2FKfth9OKx5V4U9sY9jVk0c5bjtr9FKijtY97gPTrwpfmrMDyOIEihDJXuSAmnZ6WG6gQWZq7A/1DYMDpFIxLX2eWcAAyRvwW0xD9CJJWu378LFWU7w=="}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:50:44.960954 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-4bc0fd8a-60f2-493a-b251-fd9030ad0a82 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Getting quotas for project 2f074c24f4594fa89de6dfe2e38659c3. Resources: {'key_pairs'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:50:44.965386 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-4bc0fd8a-60f2-493a-b251-fd9030ad0a82 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Getting quotas for user 7ca3187ddb684fd1b90463f4adf4282d and project 2f074c24f4594fa89de6dfe2e38659c3. Resources: {'key_pairs'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:50:44.998299 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4bc0fd8a-60f2-493a-b251-fd9030ad0a82 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.176393 May 16 17:50:44.999006 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 453/925] 10.222.0.58 () {60 vars in 1158 bytes} [Mon May 16 17:50:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:50:45.029069 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-23966852-acc1-4789-b760-1f6912f37448 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:45.039469 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-23966852-acc1-4789-b760-1f6912f37448 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 200 len: 1265 microversion: 2.1 time: 0.166376 May 16 17:50:45.040564 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 473/926] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:44 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:50:46.058912 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e410ac10-8832-449d-9e2f-312f4dee185f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:46.059749 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e410ac10-8832-449d-9e2f-312f4dee185f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:46.067766 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e410ac10-8832-449d-9e2f-312f4dee185f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:46.068418 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e410ac10-8832-449d-9e2f-312f4dee185f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:46.069404 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e410ac10-8832-449d-9e2f-312f4dee185f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:46.069866 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e410ac10-8832-449d-9e2f-312f4dee185f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:46.312304 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e410ac10-8832-449d-9e2f-312f4dee185f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:46.321169 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e410ac10-8832-449d-9e2f-312f4dee185f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 200 len: 1265 microversion: 2.1 time: 0.268441 May 16 17:50:46.321779 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 454/927] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:46 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:46.381964 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e991f3f0-a9bb-49bb-9e9d-013582e4ba1d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-990922753", "imageRef": "782bd628-ef1b-419c-99f5-2c312d1766a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "70f75128-82f0-47aa-84a8-cf0120b81794"}], "security_groups": [{"name": "tempest-securitygroup--1416271923"}], "key_name": "tempest-keypair-538510642", "user_data": "}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:50:46.485951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.network.neutron [None req-e991f3f0-a9bb-49bb-9e9d-013582e4ba1d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] validate_networks() for [('70f75128-82f0-47aa-84a8-cf0120b81794', None, None, None, None, None)] {{(pid=128815) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:50:46.945737 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-e991f3f0-a9bb-49bb-9e9d-013582e4ba1d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Flavor limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:50:46.946466 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-e991f3f0-a9bb-49bb-9e9d-013582e4ba1d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Image limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:50:46.947097 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-e991f3f0-a9bb-49bb-9e9d-013582e4ba1d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Flavor pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:50:46.947500 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-e991f3f0-a9bb-49bb-9e9d-013582e4ba1d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Image pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:50:46.947911 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-e991f3f0-a9bb-49bb-9e9d-013582e4ba1d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:50:46.956795 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e991f3f0-a9bb-49bb-9e9d-013582e4ba1d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:46.960663 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e991f3f0-a9bb-49bb-9e9d-013582e4ba1d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:46.960663 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e991f3f0-a9bb-49bb-9e9d-013582e4ba1d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:46.962482 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e991f3f0-a9bb-49bb-9e9d-013582e4ba1d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:46.989860 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-e991f3f0-a9bb-49bb-9e9d-013582e4ba1d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Getting quotas for project 2f074c24f4594fa89de6dfe2e38659c3. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:50:46.994481 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-e991f3f0-a9bb-49bb-9e9d-013582e4ba1d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Getting quotas for user 7ca3187ddb684fd1b90463f4adf4282d and project 2f074c24f4594fa89de6dfe2e38659c3. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:50:47.005976 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-e991f3f0-a9bb-49bb-9e9d-013582e4ba1d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Going to run 1 instances... {{(pid=128815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:50:47.008333 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-e991f3f0-a9bb-49bb-9e9d-013582e4ba1d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='782bd628-ef1b-419c-99f5-2c312d1766a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:50:47.059993 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-e991f3f0-a9bb-49bb-9e9d-013582e4ba1d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.682420 May 16 17:50:47.060949 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 474/928] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:50:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 17:50:47.072916 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-821388da-ae08-4fb6-a06c-1bd79a539fd5 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:47.085446 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-821388da-ae08-4fb6-a06c-1bd79a539fd5 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:47.144883 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-821388da-ae08-4fb6-a06c-1bd79a539fd5 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:47.153124 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-821388da-ae08-4fb6-a06c-1bd79a539fd5 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1236 microversion: 2.1 time: 0.084134 May 16 17:50:47.154406 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 455/929] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:47 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1236 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:47.338758 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8176167f-10f7-4747-9e72-c10388d5255b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:47.339705 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-8176167f-10f7-4747-9e72-c10388d5255b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:47.346875 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8176167f-10f7-4747-9e72-c10388d5255b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:47.347364 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8176167f-10f7-4747-9e72-c10388d5255b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:47.348378 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8176167f-10f7-4747-9e72-c10388d5255b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:47.349008 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8176167f-10f7-4747-9e72-c10388d5255b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:47.705814 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-8176167f-10f7-4747-9e72-c10388d5255b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:47.724267 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-8176167f-10f7-4747-9e72-c10388d5255b tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 200 len: 1265 microversion: 2.1 time: 0.389771 May 16 17:50:47.724857 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 475/930] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:47 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 1265 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:48.170974 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e128ff52-ab42-48d5-a388-5574d19cd245 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:48.171714 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e128ff52-ab42-48d5-a388-5574d19cd245 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:48.180036 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e128ff52-ab42-48d5-a388-5574d19cd245 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:48.180705 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e128ff52-ab42-48d5-a388-5574d19cd245 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:48.181737 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e128ff52-ab42-48d5-a388-5574d19cd245 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:48.182356 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e128ff52-ab42-48d5-a388-5574d19cd245 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:48.267465 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e128ff52-ab42-48d5-a388-5574d19cd245 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:48.275175 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e128ff52-ab42-48d5-a388-5574d19cd245 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1294 microversion: 2.1 time: 0.108781 May 16 17:50:48.275746 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 456/931] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:48 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1294 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:48.740447 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-156299ea-418b-4bc1-9a00-b4c3ede2a476 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:48.741178 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-156299ea-418b-4bc1-9a00-b4c3ede2a476 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:48.747801 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-156299ea-418b-4bc1-9a00-b4c3ede2a476 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:48.748248 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-156299ea-418b-4bc1-9a00-b4c3ede2a476 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:48.749003 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-156299ea-418b-4bc1-9a00-b4c3ede2a476 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:48.749500 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-156299ea-418b-4bc1-9a00-b4c3ede2a476 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:48.971054 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-156299ea-418b-4bc1-9a00-b4c3ede2a476 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:48.978607 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-156299ea-418b-4bc1-9a00-b4c3ede2a476 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 200 len: 1265 microversion: 2.1 time: 0.242131 May 16 17:50:48.979166 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 476/932] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:48 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:49.293221 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-8f3fb76d-ed7e-4520-94d0-4f84968844b6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:49.293900 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-8f3fb76d-ed7e-4520-94d0-4f84968844b6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:49.300959 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8f3fb76d-ed7e-4520-94d0-4f84968844b6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:49.301407 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8f3fb76d-ed7e-4520-94d0-4f84968844b6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:49.302235 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8f3fb76d-ed7e-4520-94d0-4f84968844b6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:49.302648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8f3fb76d-ed7e-4520-94d0-4f84968844b6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:49.529125 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-8f3fb76d-ed7e-4520-94d0-4f84968844b6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:49.536801 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-8f3fb76d-ed7e-4520-94d0-4f84968844b6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1362 microversion: 2.1 time: 0.248033 May 16 17:50:49.537344 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 457/933] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:49 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:49.659935 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-14489cab-22a7-4259-84c8-d92720e7cc04 req-eac8a175-cba2-40c9-90b6-cc676b6fcad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d10f518-50e7-4bee-ba5b-210786b1b1b9", "tag": "c81181cb-8e54-4304-aa77-880263409e7e"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:50:49.669702 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-14489cab-22a7-4259-84c8-d92720e7cc04 req-eac8a175-cba2-40c9-90b6-cc676b6fcad0 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:49.670378 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-14489cab-22a7-4259-84c8-d92720e7cc04 req-eac8a175-cba2-40c9-90b6-cc676b6fcad0 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:49.682675 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-14489cab-22a7-4259-84c8-d92720e7cc04 req-eac8a175-cba2-40c9-90b6-cc676b6fcad0 service nova] Creating event network-changed:c81181cb-8e54-4304-aa77-880263409e7e for instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 on hv-cinder-83769 May 16 17:50:49.687818 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-14489cab-22a7-4259-84c8-d92720e7cc04 req-eac8a175-cba2-40c9-90b6-cc676b6fcad0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031729 May 16 17:50:49.688596 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 477/934] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:50:49.995776 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-bfb3ae33-fa4e-4a6f-ac68-0e04fcb154da tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:49.996384 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-bfb3ae33-fa4e-4a6f-ac68-0e04fcb154da tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:50.002432 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bfb3ae33-fa4e-4a6f-ac68-0e04fcb154da tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:50.002891 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bfb3ae33-fa4e-4a6f-ac68-0e04fcb154da tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:50.003674 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bfb3ae33-fa4e-4a6f-ac68-0e04fcb154da tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:50.004105 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-bfb3ae33-fa4e-4a6f-ac68-0e04fcb154da tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:50.216902 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-bfb3ae33-fa4e-4a6f-ac68-0e04fcb154da tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:50.224701 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-bfb3ae33-fa4e-4a6f-ac68-0e04fcb154da tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 200 len: 1265 microversion: 2.1 time: 0.232851 May 16 17:50:50.225373 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 458/935] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:49 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:50.560352 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-26b3811c-2cf9-4429-80bf-c650a4837e72 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:50.561383 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-26b3811c-2cf9-4429-80bf-c650a4837e72 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:50.576626 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-26b3811c-2cf9-4429-80bf-c650a4837e72 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:50.577382 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-26b3811c-2cf9-4429-80bf-c650a4837e72 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:50.578744 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-26b3811c-2cf9-4429-80bf-c650a4837e72 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:50.579475 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-26b3811c-2cf9-4429-80bf-c650a4837e72 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:50.732354 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-26b3811c-2cf9-4429-80bf-c650a4837e72 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:50.742641 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-26b3811c-2cf9-4429-80bf-c650a4837e72 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1362 microversion: 2.1 time: 0.190707 May 16 17:50:50.743223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 478/936] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:50 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:51.241969 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-1c0ad898-2f20-4045-8833-30c0199dbccc tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:51.242552 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-1c0ad898-2f20-4045-8833-30c0199dbccc tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:51.249058 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1c0ad898-2f20-4045-8833-30c0199dbccc tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:51.249505 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1c0ad898-2f20-4045-8833-30c0199dbccc tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:51.250346 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1c0ad898-2f20-4045-8833-30c0199dbccc tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:51.250778 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1c0ad898-2f20-4045-8833-30c0199dbccc tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:51.391170 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-1c0ad898-2f20-4045-8833-30c0199dbccc tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:51.398967 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-1c0ad898-2f20-4045-8833-30c0199dbccc tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 200 len: 1265 microversion: 2.1 time: 0.160998 May 16 17:50:51.399532 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 459/937] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:51 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:51.760181 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-595c153d-d2b4-4d4c-983e-3855689bf4df tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:51.760879 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-595c153d-d2b4-4d4c-983e-3855689bf4df tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:51.767743 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-595c153d-d2b4-4d4c-983e-3855689bf4df tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:51.768200 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-595c153d-d2b4-4d4c-983e-3855689bf4df tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:51.769002 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-595c153d-d2b4-4d4c-983e-3855689bf4df tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:51.769441 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-595c153d-d2b4-4d4c-983e-3855689bf4df tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:51.905410 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-595c153d-d2b4-4d4c-983e-3855689bf4df tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:51.913742 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-595c153d-d2b4-4d4c-983e-3855689bf4df tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1362 microversion: 2.1 time: 0.157642 May 16 17:50:51.914590 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 479/938] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:51 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:52.420135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f39bf26c-f870-4fd0-a50d-df116797f0b2 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:52.421135 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-f39bf26c-f870-4fd0-a50d-df116797f0b2 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:52.431831 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f39bf26c-f870-4fd0-a50d-df116797f0b2 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:52.432582 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f39bf26c-f870-4fd0-a50d-df116797f0b2 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:52.433910 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f39bf26c-f870-4fd0-a50d-df116797f0b2 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:52.434685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f39bf26c-f870-4fd0-a50d-df116797f0b2 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:52.576732 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f39bf26c-f870-4fd0-a50d-df116797f0b2 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:52.588012 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f39bf26c-f870-4fd0-a50d-df116797f0b2 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 200 len: 1265 microversion: 2.1 time: 0.174493 May 16 17:50:52.588788 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 460/939] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:52 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:52.935244 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-bff6cc58-fefa-41ac-93b1-b1252f0ab8f9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:52.936086 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-bff6cc58-fefa-41ac-93b1-b1252f0ab8f9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:52.946829 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bff6cc58-fefa-41ac-93b1-b1252f0ab8f9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:52.947635 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bff6cc58-fefa-41ac-93b1-b1252f0ab8f9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:52.948891 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bff6cc58-fefa-41ac-93b1-b1252f0ab8f9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:52.949622 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bff6cc58-fefa-41ac-93b1-b1252f0ab8f9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:53.086729 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-bff6cc58-fefa-41ac-93b1-b1252f0ab8f9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:53.094538 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-bff6cc58-fefa-41ac-93b1-b1252f0ab8f9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1362 microversion: 2.1 time: 0.166147 May 16 17:50:53.095110 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 480/940] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:52 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:53.354215 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-0ba0911e-43ee-4ad8-bb7e-fe18138107a2 req-836e6880-d6fc-4983-bf3c-6328b072cf60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8f1472-9a94-46a4-85ac-5570d0cf736c", "name": "network-vif-plugged", "status": "completed", "tag": "c880c8f6-9692-4951-8d4c-241bfc5f1099"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:50:53.362316 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-0ba0911e-43ee-4ad8-bb7e-fe18138107a2 req-836e6880-d6fc-4983-bf3c-6328b072cf60 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:53.362753 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-0ba0911e-43ee-4ad8-bb7e-fe18138107a2 req-836e6880-d6fc-4983-bf3c-6328b072cf60 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:53.374989 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-0ba0911e-43ee-4ad8-bb7e-fe18138107a2 req-836e6880-d6fc-4983-bf3c-6328b072cf60 service nova] Creating event network-vif-plugged:c880c8f6-9692-4951-8d4c-241bfc5f1099 for instance 7a8f1472-9a94-46a4-85ac-5570d0cf736c on hv-cinder-83769 May 16 17:50:53.379998 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-0ba0911e-43ee-4ad8-bb7e-fe18138107a2 req-836e6880-d6fc-4983-bf3c-6328b072cf60 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089471 May 16 17:50:53.380585 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 461/941] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:50:53.608295 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-af1775c8-47b2-4157-b9d2-bede98e14f9f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:53.608901 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-af1775c8-47b2-4157-b9d2-bede98e14f9f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:53.615180 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-af1775c8-47b2-4157-b9d2-bede98e14f9f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:53.615180 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-af1775c8-47b2-4157-b9d2-bede98e14f9f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:53.615990 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-af1775c8-47b2-4157-b9d2-bede98e14f9f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:53.616482 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-af1775c8-47b2-4157-b9d2-bede98e14f9f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:53.756538 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-af1775c8-47b2-4157-b9d2-bede98e14f9f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:53.764041 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-af1775c8-47b2-4157-b9d2-bede98e14f9f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 200 len: 1265 microversion: 2.1 time: 0.159656 May 16 17:50:53.764577 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 481/942] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:53 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:54.116961 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-dde3d32e-eb45-49ac-bf33-62e740e07ea3 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:54.118152 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-dde3d32e-eb45-49ac-bf33-62e740e07ea3 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:54.129153 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-dde3d32e-eb45-49ac-bf33-62e740e07ea3 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:54.129964 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-dde3d32e-eb45-49ac-bf33-62e740e07ea3 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:54.131252 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-dde3d32e-eb45-49ac-bf33-62e740e07ea3 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:54.132041 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-dde3d32e-eb45-49ac-bf33-62e740e07ea3 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:54.271420 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-dde3d32e-eb45-49ac-bf33-62e740e07ea3 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:54.279553 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-dde3d32e-eb45-49ac-bf33-62e740e07ea3 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1362 microversion: 2.1 time: 0.170415 May 16 17:50:54.280167 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 462/943] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:54 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:54.780765 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8e2813e2-400e-4bb4-b783-cfcaf473293f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:54.781368 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-8e2813e2-400e-4bb4-b783-cfcaf473293f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:54.788650 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8e2813e2-400e-4bb4-b783-cfcaf473293f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:54.789434 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8e2813e2-400e-4bb4-b783-cfcaf473293f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:54.790283 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8e2813e2-400e-4bb4-b783-cfcaf473293f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:54.790722 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8e2813e2-400e-4bb4-b783-cfcaf473293f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:54.921505 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-8e2813e2-400e-4bb4-b783-cfcaf473293f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:54.929087 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-8e2813e2-400e-4bb4-b783-cfcaf473293f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 200 len: 1265 microversion: 2.1 time: 0.152486 May 16 17:50:54.929585 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 482/944] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:54 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:55.298507 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a93c645e-70f5-4bc7-ba09-0c497232c14d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:55.299347 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a93c645e-70f5-4bc7-ba09-0c497232c14d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:55.307170 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a93c645e-70f5-4bc7-ba09-0c497232c14d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:55.307654 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a93c645e-70f5-4bc7-ba09-0c497232c14d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:55.308429 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a93c645e-70f5-4bc7-ba09-0c497232c14d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:55.308869 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a93c645e-70f5-4bc7-ba09-0c497232c14d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:55.395908 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-533c0c57-91af-4bd5-8f62-9138a3c961a6 req-1aab492b-686c-4796-b604-457cc196af91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d10f518-50e7-4bee-ba5b-210786b1b1b9", "name": "network-vif-plugged", "status": "completed", "tag": "c81181cb-8e54-4304-aa77-880263409e7e"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:50:55.404640 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-533c0c57-91af-4bd5-8f62-9138a3c961a6 req-1aab492b-686c-4796-b604-457cc196af91 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:55.405080 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-533c0c57-91af-4bd5-8f62-9138a3c961a6 req-1aab492b-686c-4796-b604-457cc196af91 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:55.416799 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-533c0c57-91af-4bd5-8f62-9138a3c961a6 req-1aab492b-686c-4796-b604-457cc196af91 service nova] Creating event network-vif-plugged:c81181cb-8e54-4304-aa77-880263409e7e for instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 on hv-cinder-83769 May 16 17:50:55.422196 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-533c0c57-91af-4bd5-8f62-9138a3c961a6 req-1aab492b-686c-4796-b604-457cc196af91 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030022 May 16 17:50:55.422775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 483/945] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:50:55.444443 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-a93c645e-70f5-4bc7-ba09-0c497232c14d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:55.452019 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a93c645e-70f5-4bc7-ba09-0c497232c14d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1362 microversion: 2.1 time: 0.160007 May 16 17:50:55.452584 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 463/946] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:55 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:55.951809 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-cb9a811a-db3c-48b7-a204-50ba251b125f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:55.952607 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-cb9a811a-db3c-48b7-a204-50ba251b125f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:55.961731 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cb9a811a-db3c-48b7-a204-50ba251b125f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:55.962181 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cb9a811a-db3c-48b7-a204-50ba251b125f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:55.962934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cb9a811a-db3c-48b7-a204-50ba251b125f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:55.963360 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-cb9a811a-db3c-48b7-a204-50ba251b125f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:56.105234 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-cb9a811a-db3c-48b7-a204-50ba251b125f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:56.116352 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-cb9a811a-db3c-48b7-a204-50ba251b125f tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 200 len: 1452 microversion: 2.1 time: 0.171599 May 16 17:50:56.116916 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 484/947] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:55 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:56.133015 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-87a15b0e-a03f-40bd-8ac0-9f3db5cdb9c5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:56.133575 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-87a15b0e-a03f-40bd-8ac0-9f3db5cdb9c5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:56.140070 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-87a15b0e-a03f-40bd-8ac0-9f3db5cdb9c5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:56.140517 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-87a15b0e-a03f-40bd-8ac0-9f3db5cdb9c5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:56.141286 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-87a15b0e-a03f-40bd-8ac0-9f3db5cdb9c5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:56.141772 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-87a15b0e-a03f-40bd-8ac0-9f3db5cdb9c5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:56.273801 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-87a15b0e-a03f-40bd-8ac0-9f3db5cdb9c5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:56.281490 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-87a15b0e-a03f-40bd-8ac0-9f3db5cdb9c5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 200 len: 1452 microversion: 2.1 time: 0.152493 May 16 17:50:56.282106 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 464/948] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:56 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:56.470040 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-2b8e72cf-2432-461b-90e9-ecd570c235f9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:56.470637 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-2b8e72cf-2432-461b-90e9-ecd570c235f9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:56.476677 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2b8e72cf-2432-461b-90e9-ecd570c235f9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:56.477119 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2b8e72cf-2432-461b-90e9-ecd570c235f9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:56.477907 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2b8e72cf-2432-461b-90e9-ecd570c235f9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:56.478335 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-2b8e72cf-2432-461b-90e9-ecd570c235f9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:56.602639 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-2b8e72cf-2432-461b-90e9-ecd570c235f9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:56.610041 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-2b8e72cf-2432-461b-90e9-ecd570c235f9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1362 microversion: 2.1 time: 0.144466 May 16 17:50:56.610801 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 485/949] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:56 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:57.627264 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e50e73f2-e46b-4bf5-af0a-5c7bcc7dc752 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:57.627871 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e50e73f2-e46b-4bf5-af0a-5c7bcc7dc752 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:57.635105 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e50e73f2-e46b-4bf5-af0a-5c7bcc7dc752 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:57.635557 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e50e73f2-e46b-4bf5-af0a-5c7bcc7dc752 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:57.636343 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e50e73f2-e46b-4bf5-af0a-5c7bcc7dc752 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:57.636775 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e50e73f2-e46b-4bf5-af0a-5c7bcc7dc752 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:57.774411 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e50e73f2-e46b-4bf5-af0a-5c7bcc7dc752 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:50:57.782344 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e50e73f2-e46b-4bf5-af0a-5c7bcc7dc752 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1547 microversion: 2.1 time: 0.158967 May 16 17:50:57.782930 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 465/950] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:50:57 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:50:57.799612 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e279d914-90f5-4275-8fdd-71f7b73e0082 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:50:57.800268 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-e279d914-90f5-4275-8fdd-71f7b73e0082 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:50:57.807245 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e279d914-90f5-4275-8fdd-71f7b73e0082 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:57.807723 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e279d914-90f5-4275-8fdd-71f7b73e0082 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:57.808493 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e279d914-90f5-4275-8fdd-71f7b73e0082 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:57.808931 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e279d914-90f5-4275-8fdd-71f7b73e0082 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:57.885809 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-e279d914-90f5-4275-8fdd-71f7b73e0082 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090146 May 16 17:50:57.886389 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 486/951] 10.222.0.58 () {58 vars in 1274 bytes} [Mon May 16 17:50:57 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:50:58.226223 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-8c824e38-7108-4f05-8aa4-d8a634a468ff req-5e486bde-3b88-47df-a17e-ba37f467fbc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8f1472-9a94-46a4-85ac-5570d0cf736c", "tag": "c880c8f6-9692-4951-8d4c-241bfc5f1099"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:50:58.236383 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-8c824e38-7108-4f05-8aa4-d8a634a468ff req-5e486bde-3b88-47df-a17e-ba37f467fbc1 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:58.236539 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-8c824e38-7108-4f05-8aa4-d8a634a468ff req-5e486bde-3b88-47df-a17e-ba37f467fbc1 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:58.247755 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-8c824e38-7108-4f05-8aa4-d8a634a468ff req-5e486bde-3b88-47df-a17e-ba37f467fbc1 service nova] Creating event network-changed:c880c8f6-9692-4951-8d4c-241bfc5f1099 for instance 7a8f1472-9a94-46a4-85ac-5570d0cf736c on hv-cinder-83769 May 16 17:50:58.252795 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-8c824e38-7108-4f05-8aa4-d8a634a468ff req-5e486bde-3b88-47df-a17e-ba37f467fbc1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095244 May 16 17:50:58.253632 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 466/952] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:50:59.184194 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-2f5bfd26-4aee-4999-aa95-6f3757320f30 req-78719b3b-85af-4ed1-a269-3546f556f8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d10f518-50e7-4bee-ba5b-210786b1b1b9", "tag": "c81181cb-8e54-4304-aa77-880263409e7e"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:50:59.192360 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-2f5bfd26-4aee-4999-aa95-6f3757320f30 req-78719b3b-85af-4ed1-a269-3546f556f8e6 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:50:59.193067 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-2f5bfd26-4aee-4999-aa95-6f3757320f30 req-78719b3b-85af-4ed1-a269-3546f556f8e6 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:50:59.204412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-2f5bfd26-4aee-4999-aa95-6f3757320f30 req-78719b3b-85af-4ed1-a269-3546f556f8e6 service nova] Creating event network-changed:c81181cb-8e54-4304-aa77-880263409e7e for instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 on hv-cinder-83769 May 16 17:50:59.209706 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-2f5bfd26-4aee-4999-aa95-6f3757320f30 req-78719b3b-85af-4ed1-a269-3546f556f8e6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029685 May 16 17:50:59.210826 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 487/953] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:51:35.356842 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-da7d3a05-3f1b-40fe-8cad-ff565b039e52 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:51:35.357471 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-da7d3a05-3f1b-40fe-8cad-ff565b039e52 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:51:35.364130 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-da7d3a05-3f1b-40fe-8cad-ff565b039e52 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:35.365086 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-da7d3a05-3f1b-40fe-8cad-ff565b039e52 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:35.365922 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-da7d3a05-3f1b-40fe-8cad-ff565b039e52 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:35.366356 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-da7d3a05-3f1b-40fe-8cad-ff565b039e52 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:35.389865 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-da7d3a05-3f1b-40fe-8cad-ff565b039e52 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9/ips" status: 200 len: 145 microversion: 2.1 time: 0.038063 May 16 17:51:35.390425 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 467/954] 10.222.0.58 () {58 vars in 1247 bytes} [Mon May 16 17:51:35 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:51:37.670016 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-9be2750a-87cd-496c-a98a-312e3e84dfa5 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45c93606-5574-46ee-ad7f-1306a18cc7b4"}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:51:37.671160 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-9be2750a-87cd-496c-a98a-312e3e84dfa5 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:51:37.677574 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9be2750a-87cd-496c-a98a-312e3e84dfa5 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:37.678018 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9be2750a-87cd-496c-a98a-312e3e84dfa5 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:37.678815 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9be2750a-87cd-496c-a98a-312e3e84dfa5 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:37.679249 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9be2750a-87cd-496c-a98a-312e3e84dfa5 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:37.928172 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-9be2750a-87cd-496c-a98a-312e3e84dfa5 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "POST /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263562 May 16 17:51:37.928772 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 488/955] 10.222.0.58 () {60 vars in 1322 bytes} [Mon May 16 17:51:37 2022] POST /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:51:44.438223 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-8171cf7f-a2f4-4e02-a611-344997a1cd1e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:51:44.448002 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8171cf7f-a2f4-4e02-a611-344997a1cd1e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:44.448648 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-8171cf7f-a2f4-4e02-a611-344997a1cd1e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:44.508297 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-8171cf7f-a2f4-4e02-a611-344997a1cd1e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Going to try to stop instance {{(pid=128816) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 16 17:51:44.553289 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-8171cf7f-a2f4-4e02-a611-344997a1cd1e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "POST /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9/action" status: 202 len: 0 microversion: 2.1 time: 0.121645 May 16 17:51:44.553953 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 468/956] 10.222.0.58 () {60 vars in 1277 bytes} [Mon May 16 17:51:44 2022] POST /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:51:44.563386 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-b2c696d1-9b4f-41fb-995b-ea8feb8faa6a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:51:44.564096 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b2c696d1-9b4f-41fb-995b-ea8feb8faa6a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:51:44.571279 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b2c696d1-9b4f-41fb-995b-ea8feb8faa6a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:44.571738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b2c696d1-9b4f-41fb-995b-ea8feb8faa6a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:44.573176 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b2c696d1-9b4f-41fb-995b-ea8feb8faa6a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:44.573779 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b2c696d1-9b4f-41fb-995b-ea8feb8faa6a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:44.717611 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b2c696d1-9b4f-41fb-995b-ea8feb8faa6a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:51:44.725649 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-b2c696d1-9b4f-41fb-995b-ea8feb8faa6a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1722 microversion: 2.1 time: 0.167093 May 16 17:51:44.726214 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 489/957] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:51:44 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:51:45.749379 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-704977b5-230d-4bc3-ae1d-53aa07db6939 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:51:45.750483 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-704977b5-230d-4bc3-ae1d-53aa07db6939 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:51:45.757126 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-704977b5-230d-4bc3-ae1d-53aa07db6939 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:45.757585 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-704977b5-230d-4bc3-ae1d-53aa07db6939 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:45.758373 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-704977b5-230d-4bc3-ae1d-53aa07db6939 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:45.758824 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-704977b5-230d-4bc3-ae1d-53aa07db6939 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:45.892853 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-704977b5-230d-4bc3-ae1d-53aa07db6939 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:51:45.906991 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-704977b5-230d-4bc3-ae1d-53aa07db6939 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1722 microversion: 2.1 time: 0.165749 May 16 17:51:45.907639 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 469/958] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:51:45 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:51:46.928733 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-526b1f70-37e2-4d79-b9aa-f15cd47cefe7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:51:46.929703 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-526b1f70-37e2-4d79-b9aa-f15cd47cefe7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:51:46.940533 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-526b1f70-37e2-4d79-b9aa-f15cd47cefe7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:46.940983 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-526b1f70-37e2-4d79-b9aa-f15cd47cefe7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:46.941776 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-526b1f70-37e2-4d79-b9aa-f15cd47cefe7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:46.942231 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-526b1f70-37e2-4d79-b9aa-f15cd47cefe7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:47.085972 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-526b1f70-37e2-4d79-b9aa-f15cd47cefe7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:51:47.094052 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-526b1f70-37e2-4d79-b9aa-f15cd47cefe7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1722 microversion: 2.1 time: 0.171889 May 16 17:51:47.094644 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 490/959] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:51:46 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:51:48.115448 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-24d5360e-0bb3-4cab-8285-1c1201cbbcdb tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:51:48.116186 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-24d5360e-0bb3-4cab-8285-1c1201cbbcdb tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:51:48.124428 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-24d5360e-0bb3-4cab-8285-1c1201cbbcdb tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:48.124985 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-24d5360e-0bb3-4cab-8285-1c1201cbbcdb tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:48.125977 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-24d5360e-0bb3-4cab-8285-1c1201cbbcdb tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:48.126518 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-24d5360e-0bb3-4cab-8285-1c1201cbbcdb tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:48.260766 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-24d5360e-0bb3-4cab-8285-1c1201cbbcdb tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:51:48.268672 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-24d5360e-0bb3-4cab-8285-1c1201cbbcdb tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1722 microversion: 2.1 time: 0.159834 May 16 17:51:48.269237 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 470/960] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:51:48 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:51:49.289563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e7cf9261-da13-4db3-8b60-e5026f69e028 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:51:49.290769 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-e7cf9261-da13-4db3-8b60-e5026f69e028 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:51:49.299734 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e7cf9261-da13-4db3-8b60-e5026f69e028 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:49.300334 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e7cf9261-da13-4db3-8b60-e5026f69e028 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:49.301340 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e7cf9261-da13-4db3-8b60-e5026f69e028 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:49.302291 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e7cf9261-da13-4db3-8b60-e5026f69e028 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:49.443224 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-e7cf9261-da13-4db3-8b60-e5026f69e028 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:51:49.451696 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-e7cf9261-da13-4db3-8b60-e5026f69e028 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1722 microversion: 2.1 time: 0.168138 May 16 17:51:49.452277 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 491/961] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:51:49 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:51:50.473892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-079373ef-3b07-4160-8661-010df70e526a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:51:50.474847 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-079373ef-3b07-4160-8661-010df70e526a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:51:50.486314 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-079373ef-3b07-4160-8661-010df70e526a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:50.487161 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-079373ef-3b07-4160-8661-010df70e526a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:50.488535 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-079373ef-3b07-4160-8661-010df70e526a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:50.489266 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-079373ef-3b07-4160-8661-010df70e526a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:50.627449 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-079373ef-3b07-4160-8661-010df70e526a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:51:50.635674 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-079373ef-3b07-4160-8661-010df70e526a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1722 microversion: 2.1 time: 0.168701 May 16 17:51:50.636257 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 471/962] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:51:50 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:51:51.655205 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8d096399-5ea6-4090-bf83-0ad0689cde2d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:51:51.655998 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-8d096399-5ea6-4090-bf83-0ad0689cde2d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:51:51.664331 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8d096399-5ea6-4090-bf83-0ad0689cde2d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:51.665143 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8d096399-5ea6-4090-bf83-0ad0689cde2d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:51.665965 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8d096399-5ea6-4090-bf83-0ad0689cde2d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:51.666397 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8d096399-5ea6-4090-bf83-0ad0689cde2d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:51.798833 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-8d096399-5ea6-4090-bf83-0ad0689cde2d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:51:51.806956 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-8d096399-5ea6-4090-bf83-0ad0689cde2d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1722 microversion: 2.1 time: 0.156853 May 16 17:51:51.807513 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 492/963] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:51:51 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:51:52.828671 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-03bbc107-a5d6-4798-8328-97befe41ef99 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:51:52.829687 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-03bbc107-a5d6-4798-8328-97befe41ef99 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:51:52.840397 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-03bbc107-a5d6-4798-8328-97befe41ef99 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:52.841141 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-03bbc107-a5d6-4798-8328-97befe41ef99 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:52.842460 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-03bbc107-a5d6-4798-8328-97befe41ef99 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:52.843170 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-03bbc107-a5d6-4798-8328-97befe41ef99 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:52.986892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-03bbc107-a5d6-4798-8328-97befe41ef99 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:51:52.995502 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-03bbc107-a5d6-4798-8328-97befe41ef99 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1722 microversion: 2.1 time: 0.173335 May 16 17:51:52.996081 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 472/964] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:51:52 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:51:54.017251 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-3850ff45-87b4-4f99-a6f1-652a9aa6e830 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:51:54.018240 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-3850ff45-87b4-4f99-a6f1-652a9aa6e830 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:51:54.027208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3850ff45-87b4-4f99-a6f1-652a9aa6e830 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:54.027657 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3850ff45-87b4-4f99-a6f1-652a9aa6e830 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:54.028437 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3850ff45-87b4-4f99-a6f1-652a9aa6e830 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:54.028875 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3850ff45-87b4-4f99-a6f1-652a9aa6e830 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:54.436567 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3850ff45-87b4-4f99-a6f1-652a9aa6e830 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:51:54.444530 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-3850ff45-87b4-4f99-a6f1-652a9aa6e830 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1722 microversion: 2.1 time: 0.434083 May 16 17:51:54.445154 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 493/965] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:51:54 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1722 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:51:55.463105 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-dc5cc826-5222-4fa1-9742-b8fb036de54e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:51:55.463686 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-dc5cc826-5222-4fa1-9742-b8fb036de54e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:51:55.470535 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-dc5cc826-5222-4fa1-9742-b8fb036de54e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:55.473042 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-dc5cc826-5222-4fa1-9742-b8fb036de54e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:55.473042 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-dc5cc826-5222-4fa1-9742-b8fb036de54e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:55.473042 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-dc5cc826-5222-4fa1-9742-b8fb036de54e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:55.603611 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-dc5cc826-5222-4fa1-9742-b8fb036de54e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:51:55.611920 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-dc5cc826-5222-4fa1-9742-b8fb036de54e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1722 microversion: 2.1 time: 0.153184 May 16 17:51:55.612491 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 473/966] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:51:55 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:51:56.630546 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-914579c6-a84c-4969-bf1e-dfe352b93a24 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:51:56.631273 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-914579c6-a84c-4969-bf1e-dfe352b93a24 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:51:56.638619 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-914579c6-a84c-4969-bf1e-dfe352b93a24 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:56.639071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-914579c6-a84c-4969-bf1e-dfe352b93a24 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:56.639838 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-914579c6-a84c-4969-bf1e-dfe352b93a24 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:56.640274 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-914579c6-a84c-4969-bf1e-dfe352b93a24 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:56.779228 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-914579c6-a84c-4969-bf1e-dfe352b93a24 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:51:56.787619 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-914579c6-a84c-4969-bf1e-dfe352b93a24 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1722 microversion: 2.1 time: 0.161807 May 16 17:51:56.788237 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 494/967] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:51:56 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:51:57.809768 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4f78b0a8-96eb-460b-bd2c-e4c4d2275d5f tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:51:57.810382 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4f78b0a8-96eb-460b-bd2c-e4c4d2275d5f tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:51:57.817273 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4f78b0a8-96eb-460b-bd2c-e4c4d2275d5f tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:57.817766 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4f78b0a8-96eb-460b-bd2c-e4c4d2275d5f tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:57.818540 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4f78b0a8-96eb-460b-bd2c-e4c4d2275d5f tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:57.818973 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4f78b0a8-96eb-460b-bd2c-e4c4d2275d5f tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:57.959247 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-4f78b0a8-96eb-460b-bd2c-e4c4d2275d5f tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:51:57.968004 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4f78b0a8-96eb-460b-bd2c-e4c4d2275d5f tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1722 microversion: 2.1 time: 0.164538 May 16 17:51:57.968564 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 474/968] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:51:57 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:51:58.989412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-436c372d-8081-46d4-a03f-d7cc3d2253f0 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:51:58.997316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-436c372d-8081-46d4-a03f-d7cc3d2253f0 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:51:59.004254 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-436c372d-8081-46d4-a03f-d7cc3d2253f0 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:59.004965 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-436c372d-8081-46d4-a03f-d7cc3d2253f0 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:59.006307 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-436c372d-8081-46d4-a03f-d7cc3d2253f0 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:51:59.007043 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-436c372d-8081-46d4-a03f-d7cc3d2253f0 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:51:59.148315 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-436c372d-8081-46d4-a03f-d7cc3d2253f0 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:51:59.156554 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-436c372d-8081-46d4-a03f-d7cc3d2253f0 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1722 microversion: 2.1 time: 0.173575 May 16 17:51:59.157129 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 495/969] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:51:58 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:00.175960 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ea74771f-2e98-4088-a4c9-bee731046796 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:00.176693 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-ea74771f-2e98-4088-a4c9-bee731046796 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:00.184614 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ea74771f-2e98-4088-a4c9-bee731046796 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:00.185144 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ea74771f-2e98-4088-a4c9-bee731046796 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:00.186102 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ea74771f-2e98-4088-a4c9-bee731046796 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:00.186620 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ea74771f-2e98-4088-a4c9-bee731046796 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:00.322476 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-ea74771f-2e98-4088-a4c9-bee731046796 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:00.330899 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ea74771f-2e98-4088-a4c9-bee731046796 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1722 microversion: 2.1 time: 0.159586 May 16 17:52:00.331468 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 475/970] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:00 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:01.352316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-94a4bd37-1229-4536-be4f-e4775fdfc499 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:01.353264 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-94a4bd37-1229-4536-be4f-e4775fdfc499 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:01.364233 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-94a4bd37-1229-4536-be4f-e4775fdfc499 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:01.364991 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-94a4bd37-1229-4536-be4f-e4775fdfc499 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:01.366351 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-94a4bd37-1229-4536-be4f-e4775fdfc499 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:01.367166 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-94a4bd37-1229-4536-be4f-e4775fdfc499 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:01.506776 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-94a4bd37-1229-4536-be4f-e4775fdfc499 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:01.515662 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-94a4bd37-1229-4536-be4f-e4775fdfc499 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1722 microversion: 2.1 time: 0.170294 May 16 17:52:01.516236 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 496/971] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:01 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:02.537088 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-e3e4f0f9-b1c6-405d-abe3-50a88400aa48 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:02.538101 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-e3e4f0f9-b1c6-405d-abe3-50a88400aa48 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:02.547655 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e3e4f0f9-b1c6-405d-abe3-50a88400aa48 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:02.548089 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e3e4f0f9-b1c6-405d-abe3-50a88400aa48 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:02.548873 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e3e4f0f9-b1c6-405d-abe3-50a88400aa48 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:02.549305 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-e3e4f0f9-b1c6-405d-abe3-50a88400aa48 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:02.691454 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-e3e4f0f9-b1c6-405d-abe3-50a88400aa48 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:02.700488 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-e3e4f0f9-b1c6-405d-abe3-50a88400aa48 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1722 microversion: 2.1 time: 0.169858 May 16 17:52:02.701068 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 476/972] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:02 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:03.721621 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-a73c6900-c8fc-4e93-a3c9-bce8334fcfdb tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:03.722611 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-a73c6900-c8fc-4e93-a3c9-bce8334fcfdb tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:03.733441 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a73c6900-c8fc-4e93-a3c9-bce8334fcfdb tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:03.734242 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a73c6900-c8fc-4e93-a3c9-bce8334fcfdb tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:03.735506 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a73c6900-c8fc-4e93-a3c9-bce8334fcfdb tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:03.736233 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-a73c6900-c8fc-4e93-a3c9-bce8334fcfdb tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:03.871831 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-a73c6900-c8fc-4e93-a3c9-bce8334fcfdb tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:03.883975 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-a73c6900-c8fc-4e93-a3c9-bce8334fcfdb tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1722 microversion: 2.1 time: 0.168598 May 16 17:52:03.884780 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 497/973] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:03 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:04.907358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-5bbeac5d-5c16-4046-9cf6-b1c5eac186dd tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:04.908002 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-5bbeac5d-5c16-4046-9cf6-b1c5eac186dd tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:04.915132 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5bbeac5d-5c16-4046-9cf6-b1c5eac186dd tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:04.915584 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5bbeac5d-5c16-4046-9cf6-b1c5eac186dd tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:04.916344 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5bbeac5d-5c16-4046-9cf6-b1c5eac186dd tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:04.916772 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5bbeac5d-5c16-4046-9cf6-b1c5eac186dd tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:05.055849 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-5bbeac5d-5c16-4046-9cf6-b1c5eac186dd tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:05.064021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-5bbeac5d-5c16-4046-9cf6-b1c5eac186dd tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1699 microversion: 2.1 time: 0.163292 May 16 17:52:05.064601 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 477/974] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:04 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1699 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:05.080535 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-223ec13f-7ac0-4c09-93f7-a60b0b5e319b tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:52:05.087191 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-223ec13f-7ac0-4c09-93f7-a60b0b5e319b tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:05.087638 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-223ec13f-7ac0-4c09-93f7-a60b0b5e319b tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:05.148038 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-223ec13f-7ac0-4c09-93f7-a60b0b5e319b tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Going to try to start instance {{(pid=128815) start /opt/stack/nova/nova/compute/api.py:2730}} May 16 17:52:05.197121 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-223ec13f-7ac0-4c09-93f7-a60b0b5e319b tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "POST /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9/action" status: 202 len: 0 microversion: 2.1 time: 0.120334 May 16 17:52:05.197672 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 498/975] 10.222.0.58 () {60 vars in 1277 bytes} [Mon May 16 17:52:05 2022] POST /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:52:05.206109 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-96834646-6e8e-4605-9dea-18d331c16f43 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:05.207105 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-96834646-6e8e-4605-9dea-18d331c16f43 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:05.213186 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-96834646-6e8e-4605-9dea-18d331c16f43 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:05.213739 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-96834646-6e8e-4605-9dea-18d331c16f43 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:05.214593 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-96834646-6e8e-4605-9dea-18d331c16f43 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:05.215084 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-96834646-6e8e-4605-9dea-18d331c16f43 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:05.376552 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-96834646-6e8e-4605-9dea-18d331c16f43 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:05.385617 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-96834646-6e8e-4605-9dea-18d331c16f43 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1708 microversion: 2.1 time: 0.183448 May 16 17:52:05.386227 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 478/976] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:05 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1708 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:06.404464 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-8ce2cde0-090a-4b3f-ae6c-80c826ac9674 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:06.405222 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-8ce2cde0-090a-4b3f-ae6c-80c826ac9674 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:06.411930 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8ce2cde0-090a-4b3f-ae6c-80c826ac9674 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:06.412371 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8ce2cde0-090a-4b3f-ae6c-80c826ac9674 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:06.413139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8ce2cde0-090a-4b3f-ae6c-80c826ac9674 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:06.413591 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-8ce2cde0-090a-4b3f-ae6c-80c826ac9674 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:06.550562 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-8ce2cde0-090a-4b3f-ae6c-80c826ac9674 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:06.558521 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-8ce2cde0-090a-4b3f-ae6c-80c826ac9674 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1708 microversion: 2.1 time: 0.158965 May 16 17:52:06.559137 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 499/977] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:06 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1708 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:07.581506 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-7b20364c-b3b6-4b7b-8ad8-e1efaea8a5a1 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:07.582186 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-7b20364c-b3b6-4b7b-8ad8-e1efaea8a5a1 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:07.589241 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7b20364c-b3b6-4b7b-8ad8-e1efaea8a5a1 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:07.589720 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7b20364c-b3b6-4b7b-8ad8-e1efaea8a5a1 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:07.590497 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7b20364c-b3b6-4b7b-8ad8-e1efaea8a5a1 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:07.590943 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7b20364c-b3b6-4b7b-8ad8-e1efaea8a5a1 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:07.728152 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-7b20364c-b3b6-4b7b-8ad8-e1efaea8a5a1 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:07.736413 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-7b20364c-b3b6-4b7b-8ad8-e1efaea8a5a1 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1712 microversion: 2.1 time: 0.162787 May 16 17:52:07.736990 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 479/978] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:07 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1712 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:32.659982 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-bfb65cc3-4d8a-4143-9bb2-6303f453d841 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1623555106", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1341442974", "security_groups": [{"name": "tempest-secgroup-smoke-941768447"}], "block_device_mapping_v2": [{"uuid": "c78e5381-69fd-4cee-a9d8-90010227d901", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "20304413-223e-468b-b381-be0770314d15"}]}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:52:32.783332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.network.neutron [None req-bfb65cc3-4d8a-4143-9bb2-6303f453d841 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] validate_networks() for [('20304413-223e-468b-b381-be0770314d15', None, None, None, None, None)] {{(pid=128815) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:52:33.148643 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-bfb65cc3-4d8a-4143-9bb2-6303f453d841 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Flavor limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:52:33.149258 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-bfb65cc3-4d8a-4143-9bb2-6303f453d841 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Image limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:52:33.149997 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-bfb65cc3-4d8a-4143-9bb2-6303f453d841 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Flavor pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:52:33.150595 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-bfb65cc3-4d8a-4143-9bb2-6303f453d841 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Image pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:52:33.151180 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-bfb65cc3-4d8a-4143-9bb2-6303f453d841 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:52:33.165974 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bfb65cc3-4d8a-4143-9bb2-6303f453d841 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:33.166539 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bfb65cc3-4d8a-4143-9bb2-6303f453d841 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:33.167639 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bfb65cc3-4d8a-4143-9bb2-6303f453d841 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:33.168072 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-bfb65cc3-4d8a-4143-9bb2-6303f453d841 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:33.185049 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-bfb65cc3-4d8a-4143-9bb2-6303f453d841 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Getting quotas for project 782ab44dbedd4b94b6c8fb2414a51a79. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:52:33.189834 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-bfb65cc3-4d8a-4143-9bb2-6303f453d841 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Getting quotas for user bb1a88c50d7f46e297e683e6c7ef033e and project 782ab44dbedd4b94b6c8fb2414a51a79. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:52:33.251303 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-bfb65cc3-4d8a-4143-9bb2-6303f453d841 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Going to run 1 instances... {{(pid=128815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:52:33.253384 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-bfb65cc3-4d8a-4143-9bb2-6303f453d841 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c78e5381-69fd-4cee-a9d8-90010227d901',volume_size=None,volume_type=None)] {{(pid=128815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:52:33.390723 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-bfb65cc3-4d8a-4143-9bb2-6303f453d841 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.734722 May 16 17:52:33.391679 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 500/979] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:52:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:52:33.401915 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-58b27d5f-fed0-4e08-ad09-efca098f2dbd tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:33.402690 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-58b27d5f-fed0-4e08-ad09-efca098f2dbd tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:33.467728 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-58b27d5f-fed0-4e08-ad09-efca098f2dbd tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:33.475468 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-58b27d5f-fed0-4e08-ad09-efca098f2dbd tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 200 len: 1095 microversion: 2.1 time: 0.077674 May 16 17:52:33.476058 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 480/980] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:33 2022] GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:34.493191 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-12bc3906-7b6b-407c-8c35-2a4360cb0148 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:34.493844 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-12bc3906-7b6b-407c-8c35-2a4360cb0148 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:34.500189 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-12bc3906-7b6b-407c-8c35-2a4360cb0148 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:34.500643 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-12bc3906-7b6b-407c-8c35-2a4360cb0148 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:34.501809 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-12bc3906-7b6b-407c-8c35-2a4360cb0148 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:34.502251 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-12bc3906-7b6b-407c-8c35-2a4360cb0148 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:34.571324 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-12bc3906-7b6b-407c-8c35-2a4360cb0148 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:34.579003 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-12bc3906-7b6b-407c-8c35-2a4360cb0148 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 200 len: 1211 microversion: 2.1 time: 0.090417 May 16 17:52:34.579627 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 501/981] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:34 2022] GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:35.597800 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-06fcce7a-c694-413f-99dd-cca3c9e0609d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:35.599449 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-06fcce7a-c694-413f-99dd-cca3c9e0609d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:35.607535 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-06fcce7a-c694-413f-99dd-cca3c9e0609d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:35.608062 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-06fcce7a-c694-413f-99dd-cca3c9e0609d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:35.608909 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-06fcce7a-c694-413f-99dd-cca3c9e0609d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:35.609403 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-06fcce7a-c694-413f-99dd-cca3c9e0609d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:35.797711 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-5849404c-19c9-4025-b1b6-7695187930cf req-0f98b284-c914-418e-af34-ad06835f1341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dae45fc0-77b7-4939-9f9b-05225d116a5b", "tag": "bc83479d-4dba-45c2-bd9b-eeee1adfc294"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:52:35.819085 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-5849404c-19c9-4025-b1b6-7695187930cf req-0f98b284-c914-418e-af34-ad06835f1341 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:35.819709 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-5849404c-19c9-4025-b1b6-7695187930cf req-0f98b284-c914-418e-af34-ad06835f1341 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:35.825791 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-06fcce7a-c694-413f-99dd-cca3c9e0609d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:35.833135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-5849404c-19c9-4025-b1b6-7695187930cf req-0f98b284-c914-418e-af34-ad06835f1341 service nova] Creating event network-changed:bc83479d-4dba-45c2-bd9b-eeee1adfc294 for instance dae45fc0-77b7-4939-9f9b-05225d116a5b on hv-cinder-83769 May 16 17:52:35.836501 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-06fcce7a-c694-413f-99dd-cca3c9e0609d tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 200 len: 1266 microversion: 2.1 time: 0.243668 May 16 17:52:35.837735 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 481/982] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:35 2022] GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:35.847724 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-5849404c-19c9-4025-b1b6-7695187930cf req-0f98b284-c914-418e-af34-ad06835f1341 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054561 May 16 17:52:35.848333 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 502/983] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:52:36.853989 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-19e8b8b3-268d-4fd5-b264-b0fa524f4d75 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:36.854560 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-19e8b8b3-268d-4fd5-b264-b0fa524f4d75 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:36.861352 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-19e8b8b3-268d-4fd5-b264-b0fa524f4d75 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:36.861847 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-19e8b8b3-268d-4fd5-b264-b0fa524f4d75 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:36.862624 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-19e8b8b3-268d-4fd5-b264-b0fa524f4d75 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:36.863061 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-19e8b8b3-268d-4fd5-b264-b0fa524f4d75 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:37.050278 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-19e8b8b3-268d-4fd5-b264-b0fa524f4d75 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:37.057852 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-19e8b8b3-268d-4fd5-b264-b0fa524f4d75 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 200 len: 1266 microversion: 2.1 time: 0.207924 May 16 17:52:37.058415 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 482/984] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:36 2022] GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:38.079893 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-db9fcb77-6ec4-4c7b-9cd4-bc05880e69b7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:38.081068 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-db9fcb77-6ec4-4c7b-9cd4-bc05880e69b7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:38.092364 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-db9fcb77-6ec4-4c7b-9cd4-bc05880e69b7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:38.093103 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-db9fcb77-6ec4-4c7b-9cd4-bc05880e69b7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:38.094412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-db9fcb77-6ec4-4c7b-9cd4-bc05880e69b7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:38.095135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-db9fcb77-6ec4-4c7b-9cd4-bc05880e69b7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:38.234410 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-db9fcb77-6ec4-4c7b-9cd4-bc05880e69b7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:38.242092 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-db9fcb77-6ec4-4c7b-9cd4-bc05880e69b7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 200 len: 1266 microversion: 2.1 time: 0.169418 May 16 17:52:38.242648 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 503/985] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:38 2022] GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:39.264323 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-573c439f-9775-419d-abf1-570de2a480a3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:39.265316 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-573c439f-9775-419d-abf1-570de2a480a3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:39.275783 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-573c439f-9775-419d-abf1-570de2a480a3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:39.276532 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-573c439f-9775-419d-abf1-570de2a480a3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:39.277873 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-573c439f-9775-419d-abf1-570de2a480a3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:39.278606 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-573c439f-9775-419d-abf1-570de2a480a3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:39.424126 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-573c439f-9775-419d-abf1-570de2a480a3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:39.435125 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-573c439f-9775-419d-abf1-570de2a480a3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 200 len: 1266 microversion: 2.1 time: 0.178144 May 16 17:52:39.435708 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 483/986] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:39 2022] GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:40.457367 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f1d481d1-d1b7-4d50-a1ef-4a85cc8ebd18 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:40.458322 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-f1d481d1-d1b7-4d50-a1ef-4a85cc8ebd18 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:40.469037 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f1d481d1-d1b7-4d50-a1ef-4a85cc8ebd18 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:40.469837 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f1d481d1-d1b7-4d50-a1ef-4a85cc8ebd18 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:40.471105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f1d481d1-d1b7-4d50-a1ef-4a85cc8ebd18 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:40.471870 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f1d481d1-d1b7-4d50-a1ef-4a85cc8ebd18 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:40.611563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-f1d481d1-d1b7-4d50-a1ef-4a85cc8ebd18 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:40.618994 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f1d481d1-d1b7-4d50-a1ef-4a85cc8ebd18 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 200 len: 1266 microversion: 2.1 time: 0.168323 May 16 17:52:40.619559 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 504/987] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:40 2022] GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:41.142553 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-730856db-8e00-4a39-9e3e-f9cf8f6a993f tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:41.143471 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-730856db-8e00-4a39-9e3e-f9cf8f6a993f tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:41.154462 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-730856db-8e00-4a39-9e3e-f9cf8f6a993f tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:41.155229 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-730856db-8e00-4a39-9e3e-f9cf8f6a993f tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:41.156652 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-730856db-8e00-4a39-9e3e-f9cf8f6a993f tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:41.157377 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-730856db-8e00-4a39-9e3e-f9cf8f6a993f tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:41.243870 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-730856db-8e00-4a39-9e3e-f9cf8f6a993f tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lazy-loading 'services' on Instance uuid 1d10f518-50e7-4bee-ba5b-210786b1b1b9 {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:52:41.320712 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-730856db-8e00-4a39-9e3e-f9cf8f6a993f tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9/os-volume_attachments/45c93606-5574-46ee-ad7f-1306a18cc7b4" status: 202 len: 0 microversion: 2.1 time: 0.184881 May 16 17:52:41.321344 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 484/988] 10.222.0.58 () {58 vars in 1415 bytes} [Mon May 16 17:52:41 2022] DELETE /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9/os-volume_attachments/45c93606-5574-46ee-ad7f-1306a18cc7b4 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:52:41.639920 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-7503b31d-0ba9-4807-8f2f-e02292cb2e92 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:41.640961 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-7503b31d-0ba9-4807-8f2f-e02292cb2e92 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:41.651824 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7503b31d-0ba9-4807-8f2f-e02292cb2e92 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:41.652566 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7503b31d-0ba9-4807-8f2f-e02292cb2e92 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:41.653857 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7503b31d-0ba9-4807-8f2f-e02292cb2e92 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:41.654256 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-7503b31d-0ba9-4807-8f2f-e02292cb2e92 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:41.791695 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-7503b31d-0ba9-4807-8f2f-e02292cb2e92 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:41.802106 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-7503b31d-0ba9-4807-8f2f-e02292cb2e92 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 200 len: 1266 microversion: 2.1 time: 0.168751 May 16 17:52:41.802688 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 505/989] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:41 2022] GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:42.829151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-9b261979-520e-4686-8832-3958af5b7ce5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:42.829888 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-9b261979-520e-4686-8832-3958af5b7ce5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:42.836905 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9b261979-520e-4686-8832-3958af5b7ce5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:42.837356 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9b261979-520e-4686-8832-3958af5b7ce5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:42.838174 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9b261979-520e-4686-8832-3958af5b7ce5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:42.838608 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-9b261979-520e-4686-8832-3958af5b7ce5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:42.979230 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-9b261979-520e-4686-8832-3958af5b7ce5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:42.990365 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-9b261979-520e-4686-8832-3958af5b7ce5 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 200 len: 1266 microversion: 2.1 time: 0.165896 May 16 17:52:42.990922 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 485/990] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:42 2022] GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:43.509577 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-fdb6c359-51a7-4608-9c57-068080c75b1a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:52:43.516581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fdb6c359-51a7-4608-9c57-068080c75b1a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:43.517030 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fdb6c359-51a7-4608-9c57-068080c75b1a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:43.540614 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-fdb6c359-51a7-4608-9c57-068080c75b1a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Going to try to stop instance {{(pid=128815) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 16 17:52:43.588870 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-fdb6c359-51a7-4608-9c57-068080c75b1a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "POST /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9/action" status: 202 len: 0 microversion: 2.1 time: 0.083040 May 16 17:52:43.589428 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 506/991] 10.222.0.58 () {60 vars in 1277 bytes} [Mon May 16 17:52:43 2022] POST /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:52:43.597809 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-07de3b05-a1e4-4ea1-b9ee-ae592a5bfee6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:43.598650 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-07de3b05-a1e4-4ea1-b9ee-ae592a5bfee6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:43.606685 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-07de3b05-a1e4-4ea1-b9ee-ae592a5bfee6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:43.607369 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-07de3b05-a1e4-4ea1-b9ee-ae592a5bfee6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:43.608165 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-07de3b05-a1e4-4ea1-b9ee-ae592a5bfee6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:43.608597 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-07de3b05-a1e4-4ea1-b9ee-ae592a5bfee6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:43.739506 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-07de3b05-a1e4-4ea1-b9ee-ae592a5bfee6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:43.747524 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-07de3b05-a1e4-4ea1-b9ee-ae592a5bfee6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1676 microversion: 2.1 time: 0.153549 May 16 17:52:43.748209 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 486/992] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:43 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:44.008681 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-9368f76a-ffe7-47b5-98be-d6dd7089379c tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:44.009373 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-9368f76a-ffe7-47b5-98be-d6dd7089379c tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:44.015936 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9368f76a-ffe7-47b5-98be-d6dd7089379c tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:44.016375 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9368f76a-ffe7-47b5-98be-d6dd7089379c tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:44.017129 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9368f76a-ffe7-47b5-98be-d6dd7089379c tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:44.017580 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9368f76a-ffe7-47b5-98be-d6dd7089379c tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:44.160307 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-9368f76a-ffe7-47b5-98be-d6dd7089379c tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:44.168556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-9368f76a-ffe7-47b5-98be-d6dd7089379c tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 200 len: 1266 microversion: 2.1 time: 0.164147 May 16 17:52:44.169277 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 507/993] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:44 2022] GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:44.767311 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-2edd0e25-0d8e-4986-843f-100a942818fd tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:44.768000 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-2edd0e25-0d8e-4986-843f-100a942818fd tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:44.775856 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2edd0e25-0d8e-4986-843f-100a942818fd tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:44.776389 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2edd0e25-0d8e-4986-843f-100a942818fd tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:44.777290 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2edd0e25-0d8e-4986-843f-100a942818fd tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:44.777855 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-2edd0e25-0d8e-4986-843f-100a942818fd tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:44.912512 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-2edd0e25-0d8e-4986-843f-100a942818fd tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:44.920682 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-2edd0e25-0d8e-4986-843f-100a942818fd tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1676 microversion: 2.1 time: 0.158359 May 16 17:52:44.921263 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 487/994] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:44 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:45.191499 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-703dc227-e1e2-4db7-9c9a-1d2bf4b6c612 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:45.192433 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-703dc227-e1e2-4db7-9c9a-1d2bf4b6c612 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:45.203343 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-703dc227-e1e2-4db7-9c9a-1d2bf4b6c612 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:45.204100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-703dc227-e1e2-4db7-9c9a-1d2bf4b6c612 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:45.205382 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-703dc227-e1e2-4db7-9c9a-1d2bf4b6c612 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:45.206172 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-703dc227-e1e2-4db7-9c9a-1d2bf4b6c612 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:45.348037 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-703dc227-e1e2-4db7-9c9a-1d2bf4b6c612 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:45.359294 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-703dc227-e1e2-4db7-9c9a-1d2bf4b6c612 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 200 len: 1266 microversion: 2.1 time: 0.174235 May 16 17:52:45.360149 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 508/995] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:45 2022] GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:45.781191 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-67bc53a7-8b34-4bfc-a6a9-69ba525d2d52 req-72041225-215c-4184-ad22-83b55922ec0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dae45fc0-77b7-4939-9f9b-05225d116a5b", "name": "network-vif-plugged", "status": "completed", "tag": "bc83479d-4dba-45c2-bd9b-eeee1adfc294"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:52:45.790038 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-67bc53a7-8b34-4bfc-a6a9-69ba525d2d52 req-72041225-215c-4184-ad22-83b55922ec0a service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:45.790858 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-67bc53a7-8b34-4bfc-a6a9-69ba525d2d52 req-72041225-215c-4184-ad22-83b55922ec0a service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:45.802324 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-67bc53a7-8b34-4bfc-a6a9-69ba525d2d52 req-72041225-215c-4184-ad22-83b55922ec0a service nova] Creating event network-vif-plugged:bc83479d-4dba-45c2-bd9b-eeee1adfc294 for instance dae45fc0-77b7-4939-9f9b-05225d116a5b on hv-cinder-83769 May 16 17:52:45.807406 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-67bc53a7-8b34-4bfc-a6a9-69ba525d2d52 req-72041225-215c-4184-ad22-83b55922ec0a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030020 May 16 17:52:45.807997 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 488/996] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:52:45.937770 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-42066431-ec8a-4ae1-88c4-5d8456825817 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:45.938290 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-42066431-ec8a-4ae1-88c4-5d8456825817 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:45.944126 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-42066431-ec8a-4ae1-88c4-5d8456825817 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:45.944563 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-42066431-ec8a-4ae1-88c4-5d8456825817 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:45.945320 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-42066431-ec8a-4ae1-88c4-5d8456825817 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:45.945779 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-42066431-ec8a-4ae1-88c4-5d8456825817 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:46.127652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-42066431-ec8a-4ae1-88c4-5d8456825817 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:46.138829 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-42066431-ec8a-4ae1-88c4-5d8456825817 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1676 microversion: 2.1 time: 0.205067 May 16 17:52:46.139683 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 509/997] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:45 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1676 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:46.382596 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-fdec9464-d091-4b7a-ac10-80199c556d65 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:46.383818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-fdec9464-d091-4b7a-ac10-80199c556d65 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:46.392131 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fdec9464-d091-4b7a-ac10-80199c556d65 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:46.392571 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fdec9464-d091-4b7a-ac10-80199c556d65 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:46.393343 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fdec9464-d091-4b7a-ac10-80199c556d65 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:46.393813 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fdec9464-d091-4b7a-ac10-80199c556d65 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:46.535113 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-fdec9464-d091-4b7a-ac10-80199c556d65 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:46.543918 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-fdec9464-d091-4b7a-ac10-80199c556d65 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 200 len: 1266 microversion: 2.1 time: 0.169522 May 16 17:52:46.544495 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 489/998] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:46 2022] GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:47.156549 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f19b45b4-ea34-4450-bd73-a8c7dea68f79 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:47.157216 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-f19b45b4-ea34-4450-bd73-a8c7dea68f79 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:47.163766 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f19b45b4-ea34-4450-bd73-a8c7dea68f79 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:47.164207 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f19b45b4-ea34-4450-bd73-a8c7dea68f79 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:47.164969 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f19b45b4-ea34-4450-bd73-a8c7dea68f79 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:47.165773 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f19b45b4-ea34-4450-bd73-a8c7dea68f79 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:47.298627 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-f19b45b4-ea34-4450-bd73-a8c7dea68f79 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:47.311060 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f19b45b4-ea34-4450-bd73-a8c7dea68f79 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1676 microversion: 2.1 time: 0.158503 May 16 17:52:47.311851 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 510/999] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:47 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:47.560855 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-90556b34-e49e-41a0-91df-36d1a3363ed1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:47.561458 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-90556b34-e49e-41a0-91df-36d1a3363ed1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:47.568244 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-90556b34-e49e-41a0-91df-36d1a3363ed1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:47.568690 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-90556b34-e49e-41a0-91df-36d1a3363ed1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:47.569446 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-90556b34-e49e-41a0-91df-36d1a3363ed1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:47.569901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-90556b34-e49e-41a0-91df-36d1a3363ed1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:47.700371 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-90556b34-e49e-41a0-91df-36d1a3363ed1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:47.708252 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-90556b34-e49e-41a0-91df-36d1a3363ed1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 200 len: 1453 microversion: 2.1 time: 0.151495 May 16 17:52:47.708818 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 490/1000] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:47 2022] GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:47.724437 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-1352ab4b-522e-471f-bbd5-2f52eb4fd464 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:47.725091 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-1352ab4b-522e-471f-bbd5-2f52eb4fd464 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:47.731135 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1352ab4b-522e-471f-bbd5-2f52eb4fd464 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:47.731591 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1352ab4b-522e-471f-bbd5-2f52eb4fd464 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:47.732366 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1352ab4b-522e-471f-bbd5-2f52eb4fd464 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:47.732808 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-1352ab4b-522e-471f-bbd5-2f52eb4fd464 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:47.865493 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-1352ab4b-522e-471f-bbd5-2f52eb4fd464 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:47.873137 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-1352ab4b-522e-471f-bbd5-2f52eb4fd464 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 200 len: 1453 microversion: 2.1 time: 0.152611 May 16 17:52:47.873734 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 511/1001] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:47 2022] GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:48.328428 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-7896d149-c5ea-4491-b108-6061cd656844 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:48.329035 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-7896d149-c5ea-4491-b108-6061cd656844 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:48.334978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7896d149-c5ea-4491-b108-6061cd656844 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:48.335420 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7896d149-c5ea-4491-b108-6061cd656844 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:48.336173 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7896d149-c5ea-4491-b108-6061cd656844 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:48.336602 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-7896d149-c5ea-4491-b108-6061cd656844 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:48.549933 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-7896d149-c5ea-4491-b108-6061cd656844 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:48.558376 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-7896d149-c5ea-4491-b108-6061cd656844 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1676 microversion: 2.1 time: 0.233828 May 16 17:52:48.558978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 491/1002] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:48 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1676 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:49.576621 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-16dec8c2-6277-4807-b0ad-3f35e8029121 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:49.577202 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-16dec8c2-6277-4807-b0ad-3f35e8029121 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:49.584093 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-16dec8c2-6277-4807-b0ad-3f35e8029121 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:49.584553 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-16dec8c2-6277-4807-b0ad-3f35e8029121 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:49.585343 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-16dec8c2-6277-4807-b0ad-3f35e8029121 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:49.585858 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-16dec8c2-6277-4807-b0ad-3f35e8029121 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:49.781993 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-16dec8c2-6277-4807-b0ad-3f35e8029121 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:49.789969 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-16dec8c2-6277-4807-b0ad-3f35e8029121 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1676 microversion: 2.1 time: 0.217521 May 16 17:52:49.791189 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 512/1003] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:49 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:49.888952 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-6ee39277-8e1b-4e1d-9d73-a34bbf10f73d req-31549b05-e3d6-438e-82b8-ad223fa35713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dae45fc0-77b7-4939-9f9b-05225d116a5b", "tag": "bc83479d-4dba-45c2-bd9b-eeee1adfc294"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:52:49.897228 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-6ee39277-8e1b-4e1d-9d73-a34bbf10f73d req-31549b05-e3d6-438e-82b8-ad223fa35713 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:49.897696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-6ee39277-8e1b-4e1d-9d73-a34bbf10f73d req-31549b05-e3d6-438e-82b8-ad223fa35713 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:49.909062 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-6ee39277-8e1b-4e1d-9d73-a34bbf10f73d req-31549b05-e3d6-438e-82b8-ad223fa35713 service nova] Creating event network-changed:bc83479d-4dba-45c2-bd9b-eeee1adfc294 for instance dae45fc0-77b7-4939-9f9b-05225d116a5b on hv-cinder-83769 May 16 17:52:49.914246 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-6ee39277-8e1b-4e1d-9d73-a34bbf10f73d req-31549b05-e3d6-438e-82b8-ad223fa35713 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029068 May 16 17:52:49.914886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 492/1004] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:52:50.807781 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-3ed7384d-a653-40f7-b26b-3e3ff5393f2e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:50.808538 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-3ed7384d-a653-40f7-b26b-3e3ff5393f2e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:50.815570 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3ed7384d-a653-40f7-b26b-3e3ff5393f2e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:50.816047 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3ed7384d-a653-40f7-b26b-3e3ff5393f2e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:50.816832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3ed7384d-a653-40f7-b26b-3e3ff5393f2e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:50.817464 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-3ed7384d-a653-40f7-b26b-3e3ff5393f2e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:50.946261 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-3ed7384d-a653-40f7-b26b-3e3ff5393f2e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:50.953999 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-3ed7384d-a653-40f7-b26b-3e3ff5393f2e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1676 microversion: 2.1 time: 0.150161 May 16 17:52:50.954573 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 513/1005] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:50 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:51.978267 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-27749c97-47c3-4bd2-b97f-f4a5d079ce73 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:51.979299 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-27749c97-47c3-4bd2-b97f-f4a5d079ce73 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:51.990103 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-27749c97-47c3-4bd2-b97f-f4a5d079ce73 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:51.990856 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-27749c97-47c3-4bd2-b97f-f4a5d079ce73 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:51.992124 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-27749c97-47c3-4bd2-b97f-f4a5d079ce73 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:51.992847 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-27749c97-47c3-4bd2-b97f-f4a5d079ce73 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:52.139882 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-27749c97-47c3-4bd2-b97f-f4a5d079ce73 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:52.147955 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-27749c97-47c3-4bd2-b97f-f4a5d079ce73 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1676 microversion: 2.1 time: 0.177909 May 16 17:52:52.148637 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 493/1006] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:51 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:53.170472 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-b96bb35d-1857-49f2-8703-c5bf95f7b9e6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:53.171074 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b96bb35d-1857-49f2-8703-c5bf95f7b9e6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:53.178007 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b96bb35d-1857-49f2-8703-c5bf95f7b9e6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:53.178390 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b96bb35d-1857-49f2-8703-c5bf95f7b9e6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:53.179147 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b96bb35d-1857-49f2-8703-c5bf95f7b9e6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:53.179573 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b96bb35d-1857-49f2-8703-c5bf95f7b9e6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:53.323414 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-b96bb35d-1857-49f2-8703-c5bf95f7b9e6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:53.331372 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-b96bb35d-1857-49f2-8703-c5bf95f7b9e6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1676 microversion: 2.1 time: 0.167120 May 16 17:52:53.331964 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 514/1007] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:53 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:54.352753 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d8d789c9-99e5-4a41-b53f-60d21b4f95b2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:54.353882 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d8d789c9-99e5-4a41-b53f-60d21b4f95b2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:54.364868 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d8d789c9-99e5-4a41-b53f-60d21b4f95b2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:54.365632 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d8d789c9-99e5-4a41-b53f-60d21b4f95b2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:54.366924 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d8d789c9-99e5-4a41-b53f-60d21b4f95b2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:54.367671 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d8d789c9-99e5-4a41-b53f-60d21b4f95b2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:54.505426 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-d8d789c9-99e5-4a41-b53f-60d21b4f95b2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:54.515560 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d8d789c9-99e5-4a41-b53f-60d21b4f95b2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1653 microversion: 2.1 time: 0.169677 May 16 17:52:54.516139 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 494/1008] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:54 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1653 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:54.534411 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-c26b7420-e974-4850-ae7b-c12d5be33492 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:52:54.544336 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c26b7420-e974-4850-ae7b-c12d5be33492 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:54.544787 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c26b7420-e974-4850-ae7b-c12d5be33492 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:54.566934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-c26b7420-e974-4850-ae7b-c12d5be33492 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Going to try to start instance {{(pid=128815) start /opt/stack/nova/nova/compute/api.py:2730}} May 16 17:52:54.617538 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-c26b7420-e974-4850-ae7b-c12d5be33492 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "POST /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9/action" status: 202 len: 0 microversion: 2.1 time: 0.089017 May 16 17:52:54.618132 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 515/1009] 10.222.0.58 () {60 vars in 1277 bytes} [Mon May 16 17:52:54 2022] POST /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:52:54.626400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f169a857-0c0c-47aa-a630-7cc386957792 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:54.627087 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-f169a857-0c0c-47aa-a630-7cc386957792 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:54.633225 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f169a857-0c0c-47aa-a630-7cc386957792 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:54.633810 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f169a857-0c0c-47aa-a630-7cc386957792 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:54.634666 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f169a857-0c0c-47aa-a630-7cc386957792 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:54.635092 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f169a857-0c0c-47aa-a630-7cc386957792 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:54.818540 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f169a857-0c0c-47aa-a630-7cc386957792 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:54.829724 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f169a857-0c0c-47aa-a630-7cc386957792 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1662 microversion: 2.1 time: 0.207052 May 16 17:52:54.830302 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 495/1010] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:54 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1662 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:55.852700 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4095fbde-8295-4a7a-aa16-35e738ab8eca tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:55.853931 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-4095fbde-8295-4a7a-aa16-35e738ab8eca tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:55.865376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4095fbde-8295-4a7a-aa16-35e738ab8eca tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:55.866285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4095fbde-8295-4a7a-aa16-35e738ab8eca tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:55.867580 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4095fbde-8295-4a7a-aa16-35e738ab8eca tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:55.868309 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4095fbde-8295-4a7a-aa16-35e738ab8eca tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:56.004793 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-4095fbde-8295-4a7a-aa16-35e738ab8eca tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:56.013012 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-4095fbde-8295-4a7a-aa16-35e738ab8eca tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1662 microversion: 2.1 time: 0.167881 May 16 17:52:56.013605 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 516/1011] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:55 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:52:57.034572 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-ed0cb9c2-984c-44e4-903a-cb0d140df5b0 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:52:57.035563 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-ed0cb9c2-984c-44e4-903a-cb0d140df5b0 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:52:57.046004 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ed0cb9c2-984c-44e4-903a-cb0d140df5b0 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:57.046449 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ed0cb9c2-984c-44e4-903a-cb0d140df5b0 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:57.047202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ed0cb9c2-984c-44e4-903a-cb0d140df5b0 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:52:57.047627 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-ed0cb9c2-984c-44e4-903a-cb0d140df5b0 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:52:57.182124 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-ed0cb9c2-984c-44e4-903a-cb0d140df5b0 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:52:57.189806 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-ed0cb9c2-984c-44e4-903a-cb0d140df5b0 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1666 microversion: 2.1 time: 0.161736 May 16 17:52:57.190359 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 496/1012] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:52:57 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:53:19.958101 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:53:19.959161 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Mon May 16 17:53:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:53:28.110598 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:53:28.111321 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Mon May 16 17:53:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:53:29.858152 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:53:29.858759 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Mon May 16 17:53:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:53:30.107839 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-b8ee9971-3569-4591-8ccb-9cce1f5b8611 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:30.110042 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-b8ee9971-3569-4591-8ccb-9cce1f5b8611 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:53:30.118818 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b8ee9971-3569-4591-8ccb-9cce1f5b8611 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:30.119269 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b8ee9971-3569-4591-8ccb-9cce1f5b8611 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:30.120038 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b8ee9971-3569-4591-8ccb-9cce1f5b8611 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:30.120505 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-b8ee9971-3569-4591-8ccb-9cce1f5b8611 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:30.152643 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-b8ee9971-3569-4591-8ccb-9cce1f5b8611 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051080 May 16 17:53:30.153190 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 517/1013] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:53:30 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 17:53:30.221122 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-846dea13-9222-4370-81ec-0b7aebf47c1b tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:30.221697 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-846dea13-9222-4370-81ec-0b7aebf47c1b tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:53:30.229024 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-846dea13-9222-4370-81ec-0b7aebf47c1b tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:30.229469 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-846dea13-9222-4370-81ec-0b7aebf47c1b tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:30.230289 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-846dea13-9222-4370-81ec-0b7aebf47c1b tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:30.230719 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-846dea13-9222-4370-81ec-0b7aebf47c1b tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:30.255505 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-846dea13-9222-4370-81ec-0b7aebf47c1b tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Going to try to terminate instance {{(pid=128816) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:53:30.346164 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-846dea13-9222-4370-81ec-0b7aebf47c1b tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 204 len: 0 microversion: 2.1 time: 0.128602 May 16 17:53:30.346692 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 497/1014] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:53:30 2022] DELETE /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:53:30.355278 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-6de32919-4d88-4404-996f-81928beccf80 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:30.355881 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-6de32919-4d88-4404-996f-81928beccf80 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:53:30.363112 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6de32919-4d88-4404-996f-81928beccf80 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:30.363560 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6de32919-4d88-4404-996f-81928beccf80 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:30.364316 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6de32919-4d88-4404-996f-81928beccf80 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:30.364736 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6de32919-4d88-4404-996f-81928beccf80 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:30.502378 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-6de32919-4d88-4404-996f-81928beccf80 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:53:30.509852 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-6de32919-4d88-4404-996f-81928beccf80 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1672 microversion: 2.1 time: 0.158813 May 16 17:53:30.510399 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 518/1015] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:53:30 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:53:31.532009 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-fc669445-1718-48e8-bc9c-895ac86270b2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:31.533153 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-fc669445-1718-48e8-bc9c-895ac86270b2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:53:31.540198 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fc669445-1718-48e8-bc9c-895ac86270b2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:31.540971 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fc669445-1718-48e8-bc9c-895ac86270b2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:31.541772 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fc669445-1718-48e8-bc9c-895ac86270b2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:31.542204 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-fc669445-1718-48e8-bc9c-895ac86270b2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:31.684398 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-fc669445-1718-48e8-bc9c-895ac86270b2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:53:31.692064 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-fc669445-1718-48e8-bc9c-895ac86270b2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1672 microversion: 2.1 time: 0.167282 May 16 17:53:31.692600 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 498/1016] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:53:31 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:53:32.708487 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-e4a90d0e-cdda-4e38-97bf-c8eb2c0c7cc4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:32.709055 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-e4a90d0e-cdda-4e38-97bf-c8eb2c0c7cc4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:53:32.715564 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e4a90d0e-cdda-4e38-97bf-c8eb2c0c7cc4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:32.716010 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e4a90d0e-cdda-4e38-97bf-c8eb2c0c7cc4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:32.716763 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e4a90d0e-cdda-4e38-97bf-c8eb2c0c7cc4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:32.717188 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-e4a90d0e-cdda-4e38-97bf-c8eb2c0c7cc4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:32.917294 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-e4a90d0e-cdda-4e38-97bf-c8eb2c0c7cc4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:53:32.924839 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-e4a90d0e-cdda-4e38-97bf-c8eb2c0c7cc4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1672 microversion: 2.1 time: 0.220457 May 16 17:53:32.925397 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 519/1017] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:53:32 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1672 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:53:33.533448 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-8b22e019-c2d0-4ded-aceb-f9a768d67b4f req-1ad2c3f8-b75e-4121-8fe4-aa6561f26c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d10f518-50e7-4bee-ba5b-210786b1b1b9", "name": "network-vif-deleted", "tag": "c81181cb-8e54-4304-aa77-880263409e7e"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:53:33.544674 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-8b22e019-c2d0-4ded-aceb-f9a768d67b4f req-1ad2c3f8-b75e-4121-8fe4-aa6561f26c90 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:33.545213 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-8b22e019-c2d0-4ded-aceb-f9a768d67b4f req-1ad2c3f8-b75e-4121-8fe4-aa6561f26c90 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:33.558266 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-8b22e019-c2d0-4ded-aceb-f9a768d67b4f req-1ad2c3f8-b75e-4121-8fe4-aa6561f26c90 service nova] Creating event network-vif-deleted:c81181cb-8e54-4304-aa77-880263409e7e for instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 on hv-cinder-83769 May 16 17:53:33.563469 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-8b22e019-c2d0-4ded-aceb-f9a768d67b4f req-1ad2c3f8-b75e-4121-8fe4-aa6561f26c90 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033957 May 16 17:53:33.564687 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 499/1018] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:53:33.943992 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-286f4929-fe48-46a6-8bf0-8a8eef4f422d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:33.944672 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-286f4929-fe48-46a6-8bf0-8a8eef4f422d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:53:33.951495 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-286f4929-fe48-46a6-8bf0-8a8eef4f422d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:33.952011 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-286f4929-fe48-46a6-8bf0-8a8eef4f422d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:33.952840 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-286f4929-fe48-46a6-8bf0-8a8eef4f422d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:33.953338 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-286f4929-fe48-46a6-8bf0-8a8eef4f422d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:33.985937 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-286f4929-fe48-46a6-8bf0-8a8eef4f422d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:33.986387 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-286f4929-fe48-46a6-8bf0-8a8eef4f422d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:33.986857 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.objects.instance [None req-286f4929-fe48-46a6-8bf0-8a8eef4f422d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lazy-loading 'fault' on Instance uuid 1d10f518-50e7-4bee-ba5b-210786b1b1b9 {{(pid=128815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:53:34.032199 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-286f4929-fe48-46a6-8bf0-8a8eef4f422d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:53:34.040120 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-286f4929-fe48-46a6-8bf0-8a8eef4f422d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 200 len: 1326 microversion: 2.1 time: 0.100139 May 16 17:53:34.041053 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 520/1019] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:53:33 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 1326 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:53:35.063153 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f030fb22-ed89-48cc-b9a3-ae02c59dc90a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:35.064345 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-f030fb22-ed89-48cc-b9a3-ae02c59dc90a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:53:35.075110 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f030fb22-ed89-48cc-b9a3-ae02c59dc90a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:35.075864 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f030fb22-ed89-48cc-b9a3-ae02c59dc90a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:35.077138 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f030fb22-ed89-48cc-b9a3-ae02c59dc90a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:35.077931 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f030fb22-ed89-48cc-b9a3-ae02c59dc90a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:35.095245 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-f030fb22-ed89-48cc-b9a3-ae02c59dc90a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] HTTP exception thrown: Instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 could not be found. May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f030fb22-ed89-48cc-b9a3-ae02c59dc90a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Request method failure captured: May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 HTTP/1.1 May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigo70q5byKpdRG-mOODDKH4Qqwl-jFiQspbiJ4jYeACYDaa3CoHIFuhwV4Jf3m9AR4T1Ypo60r6LgGo6fmX3JVt_xTOthqKmyFqHhw3dBF-Nx1AaGbqokpLkpfAuwwSAzNC3Aj44gfoxB7T7_UwS2aUW74aG_aqegTJI-APJSBj0RUXg May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 2f074c24f4594fa89de6dfe2e38659c3 May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-AttachVolumeTestJSON-1033941299 May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:53:35.096892 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:53:35.098605 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f074c24f4594fa89de6dfe2e38659c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2f074c24f4594fa89de6dfe2e38659c3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2f074c24f4594fa89de6dfe2e38659c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f074c24f4594fa89de6dfe2e38659c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:53:35.098605 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-AttachVolumeTestJSON-1033941299 May 16 17:53:35.098605 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 2f074c24f4594fa89de6dfe2e38659c3 May 16 17:53:35.098605 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1033941299 May 16 17:53:35.098605 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-AttachVolumeTestJSON-1033941299-project May 16 17:53:35.098605 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:53:35.098605 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:53:35.098605 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 7ca3187ddb684fd1b90463f4adf4282d May 16 17:53:35.098605 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-AttachVolumeTestJSON-1033941299-project May 16 17:53:35.098605 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:53:35.098605 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 could not be found. May 16 17:53:35.098605 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': '1d10f518-50e7-4bee-ba5b-210786b1b1b9'} May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 could not be found. May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:53:35.099978 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:53:35.102439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:53:35.102439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:53:35.102439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:53:35.102439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:53:35.102439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:53:35.102439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:53:35.102439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:53:35.102439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 could not be found. May 16 17:53:35.102439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:53:35.102439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:53:35.102439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:53:35.102439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:53:35.102439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:53:35.102439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:53:35.102439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:53:35.102439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:53:35.102439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 could not be found. May 16 17:53:35.102439 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:53:35.104444 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f030fb22-ed89-48cc-b9a3-ae02c59dc90a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Returning 404 to user: Instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:53:35.104444 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f030fb22-ed89-48cc-b9a3-ae02c59dc90a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 404 len: 111 microversion: 2.1 time: 0.042362 May 16 17:53:35.104444 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 500/1020] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:53:35 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:53:35.109591 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d6157d69-904e-4d1d-8f75-95dad9e729c6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '.version_select at 0x7f79a4929670>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:35.132893 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d6157d69-904e-4d1d-8f75-95dad9e729c6 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-538510642" status: 202 len: 0 microversion: 2.1 time: 0.027487 May 16 17:53:35.133447 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 521/1021] 10.222.0.58 () {58 vars in 1217 bytes} [Mon May 16 17:53:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-538510642 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:53:35.791107 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-941a57ef-78d4-4307-ad3c-1c14062b2486 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Action: 'create', calling method: .version_select at 0x7f79a492a0d0>, body: {"keypair": {"name": "tempest-keypair-1462298410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjE8SL01HcrtgCA1GTFMKTpNakfcVqdn6D/VIfqwm0YUTNNndcrRhxSpJ8Aru6QN58fj9W+3Nu9ze7BosYiQlQwZRpvKyZ5GaLpOHW3f8luM0RS0d3KAS70I7QbdqQclA=="}} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:53:35.805364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-941a57ef-78d4-4307-ad3c-1c14062b2486 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Getting quotas for project 2f074c24f4594fa89de6dfe2e38659c3. Resources: {'key_pairs'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:53:35.809318 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.quota [None req-941a57ef-78d4-4307-ad3c-1c14062b2486 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Getting quotas for user 7ca3187ddb684fd1b90463f4adf4282d and project 2f074c24f4594fa89de6dfe2e38659c3. Resources: {'key_pairs'} {{(pid=128816) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:53:35.835151 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-941a57ef-78d4-4307-ad3c-1c14062b2486 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048465 May 16 17:53:35.835730 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 501/1022] 10.222.0.58 () {60 vars in 1158 bytes} [Mon May 16 17:53:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:53:37.117888 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4678b2d5-b110-4281-a47e-4033a4dea97e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1064677525", "imageRef": "782bd628-ef1b-419c-99f5-2c312d1766a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "70f75128-82f0-47aa-84a8-cf0120b81794"}], "security_groups": [{"name": "tempest-securitygroup--748791738"}], "key_name": "tempest-keypair-1462298410", "user_data": "}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:53:37.224665 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.network.neutron [None req-4678b2d5-b110-4281-a47e-4033a4dea97e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] validate_networks() for [('70f75128-82f0-47aa-84a8-cf0120b81794', None, None, None, None, None)] {{(pid=128815) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 17:53:37.610674 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-4678b2d5-b110-4281-a47e-4033a4dea97e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Flavor limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 17:53:37.611093 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-4678b2d5-b110-4281-a47e-4033a4dea97e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Image limits 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 17:53:37.611560 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-4678b2d5-b110-4281-a47e-4033a4dea97e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Flavor pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 17:53:37.611966 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-4678b2d5-b110-4281-a47e-4033a4dea97e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Image pref 0:0:0 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 17:53:37.612371 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.virt.hardware [None req-4678b2d5-b110-4281-a47e-4033a4dea97e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 17:53:37.621300 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4678b2d5-b110-4281-a47e-4033a4dea97e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:37.621785 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4678b2d5-b110-4281-a47e-4033a4dea97e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:37.622581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4678b2d5-b110-4281-a47e-4033a4dea97e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:37.622998 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4678b2d5-b110-4281-a47e-4033a4dea97e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:37.639276 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-4678b2d5-b110-4281-a47e-4033a4dea97e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Getting quotas for project 2f074c24f4594fa89de6dfe2e38659c3. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 17:53:37.643506 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.quota [None req-4678b2d5-b110-4281-a47e-4033a4dea97e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Getting quotas for user 7ca3187ddb684fd1b90463f4adf4282d and project 2f074c24f4594fa89de6dfe2e38659c3. Resources: {'instances', 'ram', 'cores'} {{(pid=128815) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 17:53:37.655036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-4678b2d5-b110-4281-a47e-4033a4dea97e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Going to run 1 instances... {{(pid=128815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 17:53:37.657315 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-4678b2d5-b110-4281-a47e-4033a4dea97e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='782bd628-ef1b-419c-99f5-2c312d1766a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 17:53:37.701940 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-4678b2d5-b110-4281-a47e-4033a4dea97e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.589040 May 16 17:53:37.702580 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 522/1023] 10.222.0.58 () {60 vars in 1146 bytes} [Mon May 16 17:53:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 17:53:37.713433 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4b36393b-ca8c-4345-a504-651d7f84bfa7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:37.714083 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4b36393b-ca8c-4345-a504-651d7f84bfa7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:53:37.767687 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-4b36393b-ca8c-4345-a504-651d7f84bfa7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:53:37.775880 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4b36393b-ca8c-4345-a504-651d7f84bfa7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287" status: 200 len: 1238 microversion: 2.1 time: 0.067064 May 16 17:53:37.776461 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 502/1024] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:53:37 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:53:38.793065 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-d7c29ef3-4a18-494c-95c3-e2ed8280cfa7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:38.793742 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-d7c29ef3-4a18-494c-95c3-e2ed8280cfa7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:53:38.802356 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d7c29ef3-4a18-494c-95c3-e2ed8280cfa7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:38.802808 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d7c29ef3-4a18-494c-95c3-e2ed8280cfa7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:38.803579 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d7c29ef3-4a18-494c-95c3-e2ed8280cfa7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:38.804021 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-d7c29ef3-4a18-494c-95c3-e2ed8280cfa7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:38.878931 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-d7c29ef3-4a18-494c-95c3-e2ed8280cfa7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:53:38.886627 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-d7c29ef3-4a18-494c-95c3-e2ed8280cfa7 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287" status: 200 len: 1296 microversion: 2.1 time: 0.098245 May 16 17:53:38.887195 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 523/1025] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:53:38 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 => generated 1296 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:53:39.903967 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-65b36c19-b01d-4930-8c05-f98d31b9c591 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:39.904742 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-65b36c19-b01d-4930-8c05-f98d31b9c591 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:53:39.911568 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-65b36c19-b01d-4930-8c05-f98d31b9c591 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:39.912554 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-65b36c19-b01d-4930-8c05-f98d31b9c591 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:39.913588 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-65b36c19-b01d-4930-8c05-f98d31b9c591 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:39.914229 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-65b36c19-b01d-4930-8c05-f98d31b9c591 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:40.100644 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-65b36c19-b01d-4930-8c05-f98d31b9c591 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:53:40.108534 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-65b36c19-b01d-4930-8c05-f98d31b9c591 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287" status: 200 len: 1363 microversion: 2.1 time: 0.209538 May 16 17:53:40.117540 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 503/1026] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:53:39 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:53:40.158288 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-96687116-23f0-4505-add3-e68d5897b25f req-2baa2ffd-a468-4f12-b1f3-e19fb36623d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40af0a2f-7793-41b9-8bde-e13572b4c287", "tag": "30a990e5-3337-48b5-8f5b-bc59b439632c"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:53:40.173579 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-96687116-23f0-4505-add3-e68d5897b25f req-2baa2ffd-a468-4f12-b1f3-e19fb36623d3 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:40.174244 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-96687116-23f0-4505-add3-e68d5897b25f req-2baa2ffd-a468-4f12-b1f3-e19fb36623d3 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:40.187382 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-96687116-23f0-4505-add3-e68d5897b25f req-2baa2ffd-a468-4f12-b1f3-e19fb36623d3 service nova] Creating event network-changed:30a990e5-3337-48b5-8f5b-bc59b439632c for instance 40af0a2f-7793-41b9-8bde-e13572b4c287 on hv-cinder-83769 May 16 17:53:40.192380 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-96687116-23f0-4505-add3-e68d5897b25f req-2baa2ffd-a468-4f12-b1f3-e19fb36623d3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038426 May 16 17:53:40.193467 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 524/1027] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:53:41.128959 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-1ecb47e6-da24-4c28-8f91-eff7f31dd930 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:41.130057 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-1ecb47e6-da24-4c28-8f91-eff7f31dd930 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:53:41.141006 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1ecb47e6-da24-4c28-8f91-eff7f31dd930 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:41.141839 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1ecb47e6-da24-4c28-8f91-eff7f31dd930 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:41.143232 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1ecb47e6-da24-4c28-8f91-eff7f31dd930 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:41.143669 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-1ecb47e6-da24-4c28-8f91-eff7f31dd930 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:41.280219 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-1ecb47e6-da24-4c28-8f91-eff7f31dd930 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:53:41.287997 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-1ecb47e6-da24-4c28-8f91-eff7f31dd930 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287" status: 200 len: 1363 microversion: 2.1 time: 0.165831 May 16 17:53:41.288538 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 504/1028] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:53:41 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:53:42.310387 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-c447eae5-cd68-41bd-aaac-ceb2da5f1e65 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:42.311541 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-c447eae5-cd68-41bd-aaac-ceb2da5f1e65 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:53:42.320158 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c447eae5-cd68-41bd-aaac-ceb2da5f1e65 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:42.320604 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c447eae5-cd68-41bd-aaac-ceb2da5f1e65 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:42.321369 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c447eae5-cd68-41bd-aaac-ceb2da5f1e65 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:42.321827 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c447eae5-cd68-41bd-aaac-ceb2da5f1e65 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:42.480820 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-c447eae5-cd68-41bd-aaac-ceb2da5f1e65 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:53:42.488238 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-c447eae5-cd68-41bd-aaac-ceb2da5f1e65 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287" status: 200 len: 1363 microversion: 2.1 time: 0.184942 May 16 17:53:42.488803 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 525/1029] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:53:42 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:53:43.508433 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4d52b7e3-6e32-4532-a2ce-0076187e2301 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:43.509628 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4d52b7e3-6e32-4532-a2ce-0076187e2301 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:53:43.519612 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4d52b7e3-6e32-4532-a2ce-0076187e2301 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:43.520061 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4d52b7e3-6e32-4532-a2ce-0076187e2301 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:43.520851 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4d52b7e3-6e32-4532-a2ce-0076187e2301 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:43.521277 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4d52b7e3-6e32-4532-a2ce-0076187e2301 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:43.656817 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-4d52b7e3-6e32-4532-a2ce-0076187e2301 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:53:43.666006 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4d52b7e3-6e32-4532-a2ce-0076187e2301 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287" status: 200 len: 1363 microversion: 2.1 time: 0.163825 May 16 17:53:43.666577 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 505/1030] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:53:43 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:53:44.683618 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-c9c74ae2-20ff-4166-b8d6-232c2fe361c2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:44.684303 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-c9c74ae2-20ff-4166-b8d6-232c2fe361c2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:53:44.690810 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c9c74ae2-20ff-4166-b8d6-232c2fe361c2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:44.691254 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c9c74ae2-20ff-4166-b8d6-232c2fe361c2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:44.692013 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c9c74ae2-20ff-4166-b8d6-232c2fe361c2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:44.692472 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-c9c74ae2-20ff-4166-b8d6-232c2fe361c2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:44.822933 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-c9c74ae2-20ff-4166-b8d6-232c2fe361c2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:53:44.832879 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-c9c74ae2-20ff-4166-b8d6-232c2fe361c2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287" status: 200 len: 1363 microversion: 2.1 time: 0.153203 May 16 17:53:44.833443 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 526/1031] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:53:44 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:53:45.854002 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a6592d1d-b253-43f3-b0ab-849a95e47b1c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:45.854997 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a6592d1d-b253-43f3-b0ab-849a95e47b1c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:53:45.865543 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a6592d1d-b253-43f3-b0ab-849a95e47b1c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:45.866364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a6592d1d-b253-43f3-b0ab-849a95e47b1c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:45.867673 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a6592d1d-b253-43f3-b0ab-849a95e47b1c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:45.868399 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a6592d1d-b253-43f3-b0ab-849a95e47b1c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:46.008587 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-a6592d1d-b253-43f3-b0ab-849a95e47b1c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:53:46.015798 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a6592d1d-b253-43f3-b0ab-849a95e47b1c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287" status: 200 len: 1363 microversion: 2.1 time: 0.168455 May 16 17:53:46.016397 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 506/1032] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:53:45 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:53:46.074652 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-5f78eaeb-1bcc-4c24-881c-9e972b34e224 req-d7272a12-6398-4ec9-b8a9-c55b6b8923b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40af0a2f-7793-41b9-8bde-e13572b4c287", "name": "network-vif-plugged", "status": "completed", "tag": "30a990e5-3337-48b5-8f5b-bc59b439632c"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:53:46.083253 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-5f78eaeb-1bcc-4c24-881c-9e972b34e224 req-d7272a12-6398-4ec9-b8a9-c55b6b8923b3 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:46.083707 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-5f78eaeb-1bcc-4c24-881c-9e972b34e224 req-d7272a12-6398-4ec9-b8a9-c55b6b8923b3 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:46.096162 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-5f78eaeb-1bcc-4c24-881c-9e972b34e224 req-d7272a12-6398-4ec9-b8a9-c55b6b8923b3 service nova] Creating event network-vif-plugged:30a990e5-3337-48b5-8f5b-bc59b439632c for instance 40af0a2f-7793-41b9-8bde-e13572b4c287 on hv-cinder-83769 May 16 17:53:46.101208 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-5f78eaeb-1bcc-4c24-881c-9e972b34e224 req-d7272a12-6398-4ec9-b8a9-c55b6b8923b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030319 May 16 17:53:46.102056 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 527/1033] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:53:47.036810 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-6cc238e5-77aa-4840-8945-c42c464e5db9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:47.037817 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-6cc238e5-77aa-4840-8945-c42c464e5db9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:53:47.049705 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6cc238e5-77aa-4840-8945-c42c464e5db9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:47.050168 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6cc238e5-77aa-4840-8945-c42c464e5db9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:47.050952 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6cc238e5-77aa-4840-8945-c42c464e5db9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:47.051404 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-6cc238e5-77aa-4840-8945-c42c464e5db9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:47.196930 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-6cc238e5-77aa-4840-8945-c42c464e5db9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:53:47.205022 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-6cc238e5-77aa-4840-8945-c42c464e5db9 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287" status: 200 len: 1363 microversion: 2.1 time: 0.175006 May 16 17:53:47.205726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 507/1034] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:53:47 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:53:48.226162 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-58de55e7-f406-4db3-b2e0-412ea72ed261 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:48.226862 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-58de55e7-f406-4db3-b2e0-412ea72ed261 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:53:48.233722 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-58de55e7-f406-4db3-b2e0-412ea72ed261 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:48.234176 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-58de55e7-f406-4db3-b2e0-412ea72ed261 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:48.234944 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-58de55e7-f406-4db3-b2e0-412ea72ed261 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:48.235376 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-58de55e7-f406-4db3-b2e0-412ea72ed261 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:48.376674 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-58de55e7-f406-4db3-b2e0-412ea72ed261 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:53:48.385051 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-58de55e7-f406-4db3-b2e0-412ea72ed261 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287" status: 200 len: 1548 microversion: 2.1 time: 0.165207 May 16 17:53:48.385655 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 528/1035] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:53:48 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:53:48.401519 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4b68eba9-fa79-4329-adb0-8b558ef4a5f2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:53:48.402051 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4b68eba9-fa79-4329-adb0-8b558ef4a5f2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:53:48.409131 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4b68eba9-fa79-4329-adb0-8b558ef4a5f2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:48.409521 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4b68eba9-fa79-4329-adb0-8b558ef4a5f2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:48.410358 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4b68eba9-fa79-4329-adb0-8b558ef4a5f2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:48.410789 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4b68eba9-fa79-4329-adb0-8b558ef4a5f2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:48.492919 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4b68eba9-fa79-4329-adb0-8b558ef4a5f2 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094988 May 16 17:53:48.493977 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 508/1036] 10.222.0.58 () {58 vars in 1274 bytes} [Mon May 16 17:53:48 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:53:49.683223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-3032d718-4f98-47ae-96ff-60de696446ba req-9ac677c0-7d54-47f5-9f42-da2569d83726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40af0a2f-7793-41b9-8bde-e13572b4c287", "tag": "30a990e5-3337-48b5-8f5b-bc59b439632c"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:53:49.691888 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-3032d718-4f98-47ae-96ff-60de696446ba req-9ac677c0-7d54-47f5-9f42-da2569d83726 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:53:49.692336 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-3032d718-4f98-47ae-96ff-60de696446ba req-9ac677c0-7d54-47f5-9f42-da2569d83726 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:53:49.704533 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-3032d718-4f98-47ae-96ff-60de696446ba req-9ac677c0-7d54-47f5-9f42-da2569d83726 service nova] Creating event network-changed:30a990e5-3337-48b5-8f5b-bc59b439632c for instance 40af0a2f-7793-41b9-8bde-e13572b4c287 on hv-cinder-83769 May 16 17:53:49.709616 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-3032d718-4f98-47ae-96ff-60de696446ba req-9ac677c0-7d54-47f5-9f42-da2569d83726 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030122 May 16 17:53:49.710212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 529/1037] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:54:18.627766 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-74d48e0b-b13e-4938-9afd-e8566c1a3883 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:18.628348 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-74d48e0b-b13e-4938-9afd-e8566c1a3883 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:18.632109 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-43de3e2f-deed-4cc4-8b6e-1688f391f3e8 req-d93eb4dc-0ebf-48fa-a66e-11989099fc07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dae45fc0-77b7-4939-9f9b-05225d116a5b", "tag": "bc83479d-4dba-45c2-bd9b-eeee1adfc294"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:54:18.635264 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-74d48e0b-b13e-4938-9afd-e8566c1a3883 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:18.635717 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-74d48e0b-b13e-4938-9afd-e8566c1a3883 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:18.636726 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-74d48e0b-b13e-4938-9afd-e8566c1a3883 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:18.637132 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-74d48e0b-b13e-4938-9afd-e8566c1a3883 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:18.640770 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-43de3e2f-deed-4cc4-8b6e-1688f391f3e8 req-d93eb4dc-0ebf-48fa-a66e-11989099fc07 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:18.641214 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-43de3e2f-deed-4cc4-8b6e-1688f391f3e8 req-d93eb4dc-0ebf-48fa-a66e-11989099fc07 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:18.652841 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-43de3e2f-deed-4cc4-8b6e-1688f391f3e8 req-d93eb4dc-0ebf-48fa-a66e-11989099fc07 service nova] Creating event network-changed:bc83479d-4dba-45c2-bd9b-eeee1adfc294 for instance dae45fc0-77b7-4939-9f9b-05225d116a5b on hv-cinder-83769 May 16 17:54:18.658470 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-43de3e2f-deed-4cc4-8b6e-1688f391f3e8 req-d93eb4dc-0ebf-48fa-a66e-11989099fc07 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032461 May 16 17:54:18.658972 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 530/1038] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:54:18.666548 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-74d48e0b-b13e-4938-9afd-e8566c1a3883 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Going to try to terminate instance {{(pid=128816) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:54:18.754463 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-74d48e0b-b13e-4938-9afd-e8566c1a3883 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 204 len: 0 microversion: 2.1 time: 0.129846 May 16 17:54:18.756183 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 509/1039] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:54:18 2022] DELETE /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:54:18.766066 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-18caac1a-0673-4f79-a6f2-43dfe8b1e258 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:18.766770 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-18caac1a-0673-4f79-a6f2-43dfe8b1e258 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:18.773489 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-18caac1a-0673-4f79-a6f2-43dfe8b1e258 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:18.774405 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-18caac1a-0673-4f79-a6f2-43dfe8b1e258 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:18.774769 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-18caac1a-0673-4f79-a6f2-43dfe8b1e258 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:18.775223 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-18caac1a-0673-4f79-a6f2-43dfe8b1e258 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:18.921408 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-18caac1a-0673-4f79-a6f2-43dfe8b1e258 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:54:18.928971 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-18caac1a-0673-4f79-a6f2-43dfe8b1e258 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 200 len: 1576 microversion: 2.1 time: 0.167806 May 16 17:54:18.929567 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 531/1040] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:54:18 2022] GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:54:19.951672 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-5f136548-8658-4887-bbb9-b238e32711b7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:19.952826 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-5f136548-8658-4887-bbb9-b238e32711b7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:19.963202 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5f136548-8658-4887-bbb9-b238e32711b7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:19.963660 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5f136548-8658-4887-bbb9-b238e32711b7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:19.964418 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5f136548-8658-4887-bbb9-b238e32711b7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:19.964849 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5f136548-8658-4887-bbb9-b238e32711b7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:20.182815 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-5f136548-8658-4887-bbb9-b238e32711b7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:54:20.190683 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-5f136548-8658-4887-bbb9-b238e32711b7 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 200 len: 1576 microversion: 2.1 time: 0.246441 May 16 17:54:20.191236 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 510/1041] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:54:19 2022] GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 1576 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:54:20.808393 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-573e6c40-ee65-4d45-a7f6-1e2181d2f7db req-12ae46e6-7de0-43c5-9fdf-6e03209e23f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dae45fc0-77b7-4939-9f9b-05225d116a5b", "name": "network-vif-deleted", "tag": "bc83479d-4dba-45c2-bd9b-eeee1adfc294"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:54:20.817062 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-573e6c40-ee65-4d45-a7f6-1e2181d2f7db req-12ae46e6-7de0-43c5-9fdf-6e03209e23f3 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:20.817504 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-573e6c40-ee65-4d45-a7f6-1e2181d2f7db req-12ae46e6-7de0-43c5-9fdf-6e03209e23f3 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:20.828951 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-573e6c40-ee65-4d45-a7f6-1e2181d2f7db req-12ae46e6-7de0-43c5-9fdf-6e03209e23f3 service nova] Creating event network-vif-deleted:bc83479d-4dba-45c2-bd9b-eeee1adfc294 for instance dae45fc0-77b7-4939-9f9b-05225d116a5b on hv-cinder-83769 May 16 17:54:20.834475 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-573e6c40-ee65-4d45-a7f6-1e2181d2f7db req-12ae46e6-7de0-43c5-9fdf-6e03209e23f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029757 May 16 17:54:20.835093 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 532/1042] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:54:21.208554 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-5cb7395f-6973-4eb8-9b3d-242eec77bdf3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:21.209768 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-5cb7395f-6973-4eb8-9b3d-242eec77bdf3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:21.217133 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5cb7395f-6973-4eb8-9b3d-242eec77bdf3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:21.217605 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5cb7395f-6973-4eb8-9b3d-242eec77bdf3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:21.218407 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5cb7395f-6973-4eb8-9b3d-242eec77bdf3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:21.218841 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5cb7395f-6973-4eb8-9b3d-242eec77bdf3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:21.250714 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5cb7395f-6973-4eb8-9b3d-242eec77bdf3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:21.251164 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5cb7395f-6973-4eb8-9b3d-242eec77bdf3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:21.251607 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-5cb7395f-6973-4eb8-9b3d-242eec77bdf3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lazy-loading 'fault' on Instance uuid dae45fc0-77b7-4939-9f9b-05225d116a5b {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:54:21.292041 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-5cb7395f-6973-4eb8-9b3d-242eec77bdf3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:54:21.299674 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-5cb7395f-6973-4eb8-9b3d-242eec77bdf3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 200 len: 1231 microversion: 2.1 time: 0.095120 May 16 17:54:21.300216 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 511/1043] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:54:21 2022] GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:54:22.322589 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-6a4c5004-d8af-4c00-a656-327859a70efc tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:22.323768 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-6a4c5004-d8af-4c00-a656-327859a70efc tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: dae45fc0-77b7-4939-9f9b-05225d116a5b] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:22.334773 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6a4c5004-d8af-4c00-a656-327859a70efc tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:22.335509 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6a4c5004-d8af-4c00-a656-327859a70efc tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:22.336919 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6a4c5004-d8af-4c00-a656-327859a70efc tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:22.337692 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6a4c5004-d8af-4c00-a656-327859a70efc tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:22.351968 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-6a4c5004-d8af-4c00-a656-327859a70efc tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] HTTP exception thrown: Instance dae45fc0-77b7-4939-9f9b-05225d116a5b could not be found. May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-6a4c5004-d8af-4c00-a656-327859a70efc tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Request method failure captured: May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b HTTP/1.1 May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigo5IUEJBh6-I01HqPjDtxhWLhjRGKU3ZXXsmnpxGCO2smhgxS1eM5edD9p4-ZlTFOJBae5sbEyZVBPWhkl8Kez4G93D_BmH68SGG0ZXIxMeqboYkzyX7_RjpgWJbNP8cZTwoU6UNSOMx5JMVb057YF1169wO3Xwkv-v94lCIuQ4kB4s May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 782ab44dbedd4b94b6c8fb2414a51a79 May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-TestVolumeBootPattern-821215782 May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:54:22.353581 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:54:22.355311 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/782ab44dbedd4b94b6c8fb2414a51a79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_782ab44dbedd4b94b6c8fb2414a51a79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/782ab44dbedd4b94b6c8fb2414a51a79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/782ab44dbedd4b94b6c8fb2414a51a79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:54:22.355311 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-TestVolumeBootPattern-821215782 May 16 17:54:22.355311 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 782ab44dbedd4b94b6c8fb2414a51a79 May 16 17:54:22.355311 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-TestVolumeBootPattern-821215782 May 16 17:54:22.355311 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-TestVolumeBootPattern-821215782-project May 16 17:54:22.355311 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:54:22.355311 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:54:22.355311 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: bb1a88c50d7f46e297e683e6c7ef033e May 16 17:54:22.355311 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-TestVolumeBootPattern-821215782-project May 16 17:54:22.355311 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:54:22.355311 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance dae45fc0-77b7-4939-9f9b-05225d116a5b could not be found. May 16 17:54:22.355311 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': 'dae45fc0-77b7-4939-9f9b-05225d116a5b'} May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dae45fc0-77b7-4939-9f9b-05225d116a5b could not be found. May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:54:22.356139 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:54:22.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:54:22.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:54:22.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:54:22.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:54:22.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:54:22.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:54:22.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:54:22.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dae45fc0-77b7-4939-9f9b-05225d116a5b could not be found. May 16 17:54:22.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:22.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:54:22.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:22.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:22.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:54:22.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:54:22.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:54:22.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:54:22.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dae45fc0-77b7-4939-9f9b-05225d116a5b could not be found. May 16 17:54:22.357514 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:22.359212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-6a4c5004-d8af-4c00-a656-327859a70efc tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Returning 404 to user: Instance dae45fc0-77b7-4939-9f9b-05225d116a5b could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:54:22.359212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-6a4c5004-d8af-4c00-a656-327859a70efc tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b" status: 404 len: 111 microversion: 2.1 time: 0.040460 May 16 17:54:22.359212 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 533/1044] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:54:22 2022] GET /compute/v2.1/servers/dae45fc0-77b7-4939-9f9b-05225d116a5b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:54:24.312843 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-3fda332d-48f2-47c7-a572-a964b64064c4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:24.313748 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-3fda332d-48f2-47c7-a572-a964b64064c4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:24.324645 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3fda332d-48f2-47c7-a572-a964b64064c4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:24.325021 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3fda332d-48f2-47c7-a572-a964b64064c4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:24.325823 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3fda332d-48f2-47c7-a572-a964b64064c4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:24.326254 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3fda332d-48f2-47c7-a572-a964b64064c4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:24.349380 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-3fda332d-48f2-47c7-a572-a964b64064c4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/ips" status: 200 len: 144 microversion: 2.1 time: 0.043162 May 16 17:54:24.349979 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 512/1045] 10.222.0.58 () {58 vars in 1247 bytes} [Mon May 16 17:54:24 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/ips => generated 144 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:54:25.458022 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-f7b0008d-2bf9-4828-a8e3-a11b7a2142e1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:25.458531 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-f7b0008d-2bf9-4828-a8e3-a11b7a2142e1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:25.460592 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [req-2d3fb66f-b7ed-439f-a135-6b2885dee1c5 req-7454e0df-5a4e-4952-9185-9faa525f6815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8f1472-9a94-46a4-85ac-5570d0cf736c", "tag": "c880c8f6-9692-4951-8d4c-241bfc5f1099"}]} {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:54:25.465332 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f7b0008d-2bf9-4828-a8e3-a11b7a2142e1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:25.466051 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f7b0008d-2bf9-4828-a8e3-a11b7a2142e1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:25.467026 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f7b0008d-2bf9-4828-a8e3-a11b7a2142e1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:25.467467 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-f7b0008d-2bf9-4828-a8e3-a11b7a2142e1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:25.470325 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-2d3fb66f-b7ed-439f-a135-6b2885dee1c5 req-7454e0df-5a4e-4952-9185-9faa525f6815 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:25.470872 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [req-2d3fb66f-b7ed-439f-a135-6b2885dee1c5 req-7454e0df-5a4e-4952-9185-9faa525f6815 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:25.483119 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.compute.server_external_events [req-2d3fb66f-b7ed-439f-a135-6b2885dee1c5 req-7454e0df-5a4e-4952-9185-9faa525f6815 service nova] Creating event network-changed:c880c8f6-9692-4951-8d4c-241bfc5f1099 for instance 7a8f1472-9a94-46a4-85ac-5570d0cf736c on hv-cinder-83769 May 16 17:54:25.489337 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [req-2d3fb66f-b7ed-439f-a135-6b2885dee1c5 req-7454e0df-5a4e-4952-9185-9faa525f6815 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032913 May 16 17:54:25.490778 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 513/1046] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:54:25.493944 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-f7b0008d-2bf9-4828-a8e3-a11b7a2142e1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Going to try to terminate instance {{(pid=128815) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:54:25.582697 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-f7b0008d-2bf9-4828-a8e3-a11b7a2142e1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 204 len: 0 microversion: 2.1 time: 0.128415 May 16 17:54:25.584063 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 534/1047] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:54:25 2022] DELETE /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:54:25.595326 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-a91f720c-8f28-4f2a-9d05-df732b0e9441 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:25.596127 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-a91f720c-8f28-4f2a-9d05-df732b0e9441 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:25.602453 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a91f720c-8f28-4f2a-9d05-df732b0e9441 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:25.603117 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a91f720c-8f28-4f2a-9d05-df732b0e9441 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:25.603900 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a91f720c-8f28-4f2a-9d05-df732b0e9441 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:25.604337 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-a91f720c-8f28-4f2a-9d05-df732b0e9441 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:25.696235 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-08365939-e363-46ba-9607-64bed4621bbc tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "825dd313-0f0a-4eae-8324-7d8f814a84f8"}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:54:25.697396 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-08365939-e363-46ba-9607-64bed4621bbc tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:25.703556 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-08365939-e363-46ba-9607-64bed4621bbc tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:25.703901 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-08365939-e363-46ba-9607-64bed4621bbc tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:25.704668 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-08365939-e363-46ba-9607-64bed4621bbc tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:25.705093 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-08365939-e363-46ba-9607-64bed4621bbc tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:25.765999 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-a91f720c-8f28-4f2a-9d05-df732b0e9441 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:54:25.773682 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-a91f720c-8f28-4f2a-9d05-df732b0e9441 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 200 len: 1577 microversion: 2.1 time: 0.184699 May 16 17:54:25.774258 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 514/1048] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:54:25 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:54:26.768443 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-08365939-e363-46ba-9607-64bed4621bbc tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "POST /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.077078 May 16 17:54:26.775691 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 535/1049] 10.222.0.58 () {60 vars in 1322 bytes} [Mon May 16 17:54:25 2022] POST /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments => generated 194 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:54:26.791852 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-06a96777-99a5-461c-925a-cb0ac25a16d9 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:26.792738 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-06a96777-99a5-461c-925a-cb0ac25a16d9 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:26.800096 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-06a96777-99a5-461c-925a-cb0ac25a16d9 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:26.800552 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-06a96777-99a5-461c-925a-cb0ac25a16d9 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:26.802109 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-06a96777-99a5-461c-925a-cb0ac25a16d9 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:26.802548 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-06a96777-99a5-461c-925a-cb0ac25a16d9 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:26.957706 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-06a96777-99a5-461c-925a-cb0ac25a16d9 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:54:26.965802 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-06a96777-99a5-461c-925a-cb0ac25a16d9 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 200 len: 1577 microversion: 2.1 time: 0.178402 May 16 17:54:26.966372 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 515/1050] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:54:26 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 17:54:27.549769 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-0de19982-3edc-4111-8759-e41b81311e7a req-31ea1f99-ab32-405e-9a9d-2f918e0ff0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8f1472-9a94-46a4-85ac-5570d0cf736c", "name": "network-vif-deleted", "tag": "c880c8f6-9692-4951-8d4c-241bfc5f1099"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:54:27.558501 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-0de19982-3edc-4111-8759-e41b81311e7a req-31ea1f99-ab32-405e-9a9d-2f918e0ff0c5 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:27.558893 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-0de19982-3edc-4111-8759-e41b81311e7a req-31ea1f99-ab32-405e-9a9d-2f918e0ff0c5 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:27.570143 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-0de19982-3edc-4111-8759-e41b81311e7a req-31ea1f99-ab32-405e-9a9d-2f918e0ff0c5 service nova] Creating event network-vif-deleted:c880c8f6-9692-4951-8d4c-241bfc5f1099 for instance 7a8f1472-9a94-46a4-85ac-5570d0cf736c on hv-cinder-83769 May 16 17:54:27.575546 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-0de19982-3edc-4111-8759-e41b81311e7a req-31ea1f99-ab32-405e-9a9d-2f918e0ff0c5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030433 May 16 17:54:27.576129 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 536/1051] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:54:27.982917 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-52c54941-e680-4c49-acae-a5e5bedf65b1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:27.983474 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-52c54941-e680-4c49-acae-a5e5bedf65b1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:27.990114 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-52c54941-e680-4c49-acae-a5e5bedf65b1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:27.990557 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-52c54941-e680-4c49-acae-a5e5bedf65b1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:27.991363 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-52c54941-e680-4c49-acae-a5e5bedf65b1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:27.991777 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-52c54941-e680-4c49-acae-a5e5bedf65b1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:28.024622 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-52c54941-e680-4c49-acae-a5e5bedf65b1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:28.025063 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-52c54941-e680-4c49-acae-a5e5bedf65b1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:28.025494 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-52c54941-e680-4c49-acae-a5e5bedf65b1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lazy-loading 'fault' on Instance uuid 7a8f1472-9a94-46a4-85ac-5570d0cf736c {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:54:28.069295 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-52c54941-e680-4c49-acae-a5e5bedf65b1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1a88c50d7f46e297e683e6c7ef033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782ab44dbedd4b94b6c8fb2414a51a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:54:28.078808 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-52c54941-e680-4c49-acae-a5e5bedf65b1 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 200 len: 1230 microversion: 2.1 time: 0.099765 May 16 17:54:28.079300 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 516/1052] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:54:27 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:54:29.101719 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-6ac0f704-1278-4335-bd0e-b08563580951 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:29.102875 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-6ac0f704-1278-4335-bd0e-b08563580951 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 7a8f1472-9a94-46a4-85ac-5570d0cf736c] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:29.115584 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6ac0f704-1278-4335-bd0e-b08563580951 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:29.116691 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6ac0f704-1278-4335-bd0e-b08563580951 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:29.118097 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6ac0f704-1278-4335-bd0e-b08563580951 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:29.119404 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-6ac0f704-1278-4335-bd0e-b08563580951 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:29.138341 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-6ac0f704-1278-4335-bd0e-b08563580951 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] HTTP exception thrown: Instance 7a8f1472-9a94-46a4-85ac-5570d0cf736c could not be found. May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-6ac0f704-1278-4335-bd0e-b08563580951 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Request method failure captured: May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c HTTP/1.1 May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigo5IUEJBh6-I01HqPjDtxhWLhjRGKU3ZXXsmnpxGCO2smhgxS1eM5edD9p4-ZlTFOJBae5sbEyZVBPWhkl8Kez4G93D_BmH68SGG0ZXIxMeqboYkzyX7_RjpgWJbNP8cZTwoU6UNSOMx5JMVb057YF1169wO3Xwkv-v94lCIuQ4kB4s May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 782ab44dbedd4b94b6c8fb2414a51a79 May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-TestVolumeBootPattern-821215782 May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:54:29.140009 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:54:29.141678 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/782ab44dbedd4b94b6c8fb2414a51a79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_782ab44dbedd4b94b6c8fb2414a51a79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/782ab44dbedd4b94b6c8fb2414a51a79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/782ab44dbedd4b94b6c8fb2414a51a79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:54:29.141678 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-TestVolumeBootPattern-821215782 May 16 17:54:29.141678 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 782ab44dbedd4b94b6c8fb2414a51a79 May 16 17:54:29.141678 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-TestVolumeBootPattern-821215782 May 16 17:54:29.141678 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-TestVolumeBootPattern-821215782-project May 16 17:54:29.141678 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:54:29.141678 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:54:29.141678 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: bb1a88c50d7f46e297e683e6c7ef033e May 16 17:54:29.141678 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-TestVolumeBootPattern-821215782-project May 16 17:54:29.141678 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:54:29.141678 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance 7a8f1472-9a94-46a4-85ac-5570d0cf736c could not be found. May 16 17:54:29.141678 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': '7a8f1472-9a94-46a4-85ac-5570d0cf736c'} May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a8f1472-9a94-46a4-85ac-5570d0cf736c could not be found. May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:54:29.142832 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:54:29.144934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:54:29.144934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:54:29.144934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:54:29.144934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:54:29.144934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:54:29.144934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:54:29.144934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:54:29.144934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a8f1472-9a94-46a4-85ac-5570d0cf736c could not be found. May 16 17:54:29.144934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:29.144934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:54:29.144934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:29.144934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:29.144934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:54:29.144934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:54:29.144934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:54:29.144934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:54:29.144934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a8f1472-9a94-46a4-85ac-5570d0cf736c could not be found. May 16 17:54:29.144934 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:29.146518 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-6ac0f704-1278-4335-bd0e-b08563580951 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Returning 404 to user: Instance 7a8f1472-9a94-46a4-85ac-5570d0cf736c could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:54:29.146518 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-6ac0f704-1278-4335-bd0e-b08563580951 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c" status: 404 len: 111 microversion: 2.1 time: 0.047641 May 16 17:54:29.146518 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 537/1053] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:54:29 2022] GET /compute/v2.1/servers/7a8f1472-9a94-46a4-85ac-5570d0cf736c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:54:29.602669 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4db28c0b-0e28-439b-bb40-5a67d35512c9 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:29.603233 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-4db28c0b-0e28-439b-bb40-5a67d35512c9 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:29.610069 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4db28c0b-0e28-439b-bb40-5a67d35512c9 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:29.610527 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4db28c0b-0e28-439b-bb40-5a67d35512c9 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:29.611294 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4db28c0b-0e28-439b-bb40-5a67d35512c9 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:29.611730 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-4db28c0b-0e28-439b-bb40-5a67d35512c9 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:29.625535 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-4db28c0b-0e28-439b-bb40-5a67d35512c9 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] HTTP exception thrown: Instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 could not be found. May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4db28c0b-0e28-439b-bb40-5a67d35512c9 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Request method failure captured: May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: DELETE /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 HTTP/1.1 May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigo5IUEJBh6-I01HqPjDtxhWLhjRGKU3ZXXsmnpxGCO2smhgxS1eM5edD9p4-ZlTFOJBae5sbEyZVBPWhkl8Kez4G93D_BmH68SGG0ZXIxMeqboYkzyX7_RjpgWJbNP8cZTwoU6UNSOMx5JMVb057YF1169wO3Xwkv-v94lCIuQ4kB4s May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 782ab44dbedd4b94b6c8fb2414a51a79 May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-TestVolumeBootPattern-821215782 May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:54:29.627259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:54:29.628888 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/782ab44dbedd4b94b6c8fb2414a51a79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_782ab44dbedd4b94b6c8fb2414a51a79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/782ab44dbedd4b94b6c8fb2414a51a79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/782ab44dbedd4b94b6c8fb2414a51a79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:54:29.628888 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-TestVolumeBootPattern-821215782 May 16 17:54:29.628888 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 782ab44dbedd4b94b6c8fb2414a51a79 May 16 17:54:29.628888 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-TestVolumeBootPattern-821215782 May 16 17:54:29.628888 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-TestVolumeBootPattern-821215782-project May 16 17:54:29.628888 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:54:29.628888 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:54:29.628888 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: bb1a88c50d7f46e297e683e6c7ef033e May 16 17:54:29.628888 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-TestVolumeBootPattern-821215782-project May 16 17:54:29.628888 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:54:29.628888 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 could not be found. May 16 17:54:29.628888 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': '9279a4c5-c764-46b4-8028-3bb0d8de0406'} May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 could not be found. May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:54:29.629840 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 could not be found. May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 could not be found. May 16 17:54:29.631335 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:29.632859 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-4db28c0b-0e28-439b-bb40-5a67d35512c9 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Returning 404 to user: Instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:54:29.632859 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-4db28c0b-0e28-439b-bb40-5a67d35512c9 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 404 len: 111 microversion: 2.1 time: 0.030009 May 16 17:54:29.632859 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 517/1054] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:54:29 2022] DELETE /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:54:29.637811 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-770d6f08-097a-42df-8dd9-d6b3698e9edf tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:29.638456 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-770d6f08-097a-42df-8dd9-d6b3698e9edf tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] [instance: 9279a4c5-c764-46b4-8028-3bb0d8de0406] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:29.645323 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-770d6f08-097a-42df-8dd9-d6b3698e9edf tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:29.645801 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-770d6f08-097a-42df-8dd9-d6b3698e9edf tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:29.646579 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-770d6f08-097a-42df-8dd9-d6b3698e9edf tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:29.647014 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-770d6f08-097a-42df-8dd9-d6b3698e9edf tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:29.661160 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-770d6f08-097a-42df-8dd9-d6b3698e9edf tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] HTTP exception thrown: Instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 could not be found. May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-770d6f08-097a-42df-8dd9-d6b3698e9edf tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Request method failure captured: May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 HTTP/1.1 May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigo5IUEJBh6-I01HqPjDtxhWLhjRGKU3ZXXsmnpxGCO2smhgxS1eM5edD9p4-ZlTFOJBae5sbEyZVBPWhkl8Kez4G93D_BmH68SGG0ZXIxMeqboYkzyX7_RjpgWJbNP8cZTwoU6UNSOMx5JMVb057YF1169wO3Xwkv-v94lCIuQ4kB4s May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 782ab44dbedd4b94b6c8fb2414a51a79 May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-TestVolumeBootPattern-821215782 May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:54:29.662728 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:54:29.664494 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/782ab44dbedd4b94b6c8fb2414a51a79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_782ab44dbedd4b94b6c8fb2414a51a79", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/782ab44dbedd4b94b6c8fb2414a51a79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/782ab44dbedd4b94b6c8fb2414a51a79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:54:29.664494 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-TestVolumeBootPattern-821215782 May 16 17:54:29.664494 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 782ab44dbedd4b94b6c8fb2414a51a79 May 16 17:54:29.664494 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-TestVolumeBootPattern-821215782 May 16 17:54:29.664494 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-TestVolumeBootPattern-821215782-project May 16 17:54:29.664494 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:54:29.664494 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:54:29.664494 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: bb1a88c50d7f46e297e683e6c7ef033e May 16 17:54:29.664494 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-TestVolumeBootPattern-821215782-project May 16 17:54:29.664494 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:54:29.664494 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 could not be found. May 16 17:54:29.664494 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': '9279a4c5-c764-46b4-8028-3bb0d8de0406'} May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 could not be found. May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:54:29.665365 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:54:29.667285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:54:29.667285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:54:29.667285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:54:29.667285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:54:29.667285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:54:29.667285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:54:29.667285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:54:29.667285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 could not be found. May 16 17:54:29.667285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:29.667285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:54:29.667285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:29.667285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:29.667285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:54:29.667285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:54:29.667285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:54:29.667285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:54:29.667285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 could not be found. May 16 17:54:29.667285 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:29.668745 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-770d6f08-097a-42df-8dd9-d6b3698e9edf tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Returning 404 to user: Instance 9279a4c5-c764-46b4-8028-3bb0d8de0406 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:54:29.668745 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-770d6f08-097a-42df-8dd9-d6b3698e9edf tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406" status: 404 len: 111 microversion: 2.1 time: 0.030529 May 16 17:54:29.668745 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 538/1055] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:54:29 2022] GET /compute/v2.1/servers/9279a4c5-c764-46b4-8028-3bb0d8de0406 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:54:30.987585 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f090c45a-87d8-4883-9749-cb9626aa41a3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] Calling method '.version_select at 0x7f79a47e3790>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:31.006753 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f090c45a-87d8-4883-9749-cb9626aa41a3 tempest-TestVolumeBootPattern-821215782 tempest-TestVolumeBootPattern-821215782-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1341442974" status: 202 len: 0 microversion: 2.1 time: 0.023154 May 16 17:54:31.007368 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 518/1056] 10.222.0.58 () {58 vars in 1262 bytes} [Mon May 16 17:54:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1341442974 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:54:33.306670 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-9323995f-4b58-466c-b27b-fc6ae07145b8 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:33.307608 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-9323995f-4b58-466c-b27b-fc6ae07145b8 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:33.314495 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9323995f-4b58-466c-b27b-fc6ae07145b8 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:33.314938 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9323995f-4b58-466c-b27b-fc6ae07145b8 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:33.315738 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9323995f-4b58-466c-b27b-fc6ae07145b8 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:33.316170 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-9323995f-4b58-466c-b27b-fc6ae07145b8 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:33.353692 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-9323995f-4b58-466c-b27b-fc6ae07145b8 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050909 May 16 17:54:33.354280 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 539/1057] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:54:33 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:54:33.366259 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-5c176904-c544-4d5a-85b6-0f3887016c10 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:33.367351 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-5c176904-c544-4d5a-85b6-0f3887016c10 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:33.374655 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5c176904-c544-4d5a-85b6-0f3887016c10 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:33.375149 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5c176904-c544-4d5a-85b6-0f3887016c10 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:33.375935 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5c176904-c544-4d5a-85b6-0f3887016c10 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:33.376362 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-5c176904-c544-4d5a-85b6-0f3887016c10 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:33.407069 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-5c176904-c544-4d5a-85b6-0f3887016c10 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments/825dd313-0f0a-4eae-8324-7d8f814a84f8" status: 200 len: 194 microversion: 2.1 time: 0.045427 May 16 17:54:33.407835 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 519/1058] 10.222.0.58 () {58 vars in 1412 bytes} [Mon May 16 17:54:33 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments/825dd313-0f0a-4eae-8324-7d8f814a84f8 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:54:34.732330 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-416db0bd-b933-43bf-b004-fcac8c49ac73 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b792f72-4210-4042-a272-738e8c73609f"}} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:54:34.733607 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-416db0bd-b933-43bf-b004-fcac8c49ac73 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:34.740141 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-416db0bd-b933-43bf-b004-fcac8c49ac73 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:34.740594 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-416db0bd-b933-43bf-b004-fcac8c49ac73 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:34.741369 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-416db0bd-b933-43bf-b004-fcac8c49ac73 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:34.741835 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-416db0bd-b933-43bf-b004-fcac8c49ac73 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:34.987831 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-416db0bd-b933-43bf-b004-fcac8c49ac73 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "POST /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259495 May 16 17:54:34.988453 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 540/1059] 10.222.0.58 () {60 vars in 1322 bytes} [Mon May 16 17:54:34 2022] POST /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:54:41.457156 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-89f457fa-1bb8-4cec-8e34-a8ae2d37668c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:41.458291 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-89f457fa-1bb8-4cec-8e34-a8ae2d37668c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:41.465076 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-89f457fa-1bb8-4cec-8e34-a8ae2d37668c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:41.465463 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-89f457fa-1bb8-4cec-8e34-a8ae2d37668c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:41.466300 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-89f457fa-1bb8-4cec-8e34-a8ae2d37668c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:41.466729 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-89f457fa-1bb8-4cec-8e34-a8ae2d37668c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:41.496150 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-89f457fa-1bb8-4cec-8e34-a8ae2d37668c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043287 May 16 17:54:41.496696 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 520/1060] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:54:41 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:54:41.647307 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4ae6e6cc-dab0-4ea2-babd-a658a601015e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:41.647897 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-4ae6e6cc-dab0-4ea2-babd-a658a601015e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:41.660312 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4ae6e6cc-dab0-4ea2-babd-a658a601015e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:41.661515 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4ae6e6cc-dab0-4ea2-babd-a658a601015e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:41.662398 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4ae6e6cc-dab0-4ea2-babd-a658a601015e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:41.663074 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4ae6e6cc-dab0-4ea2-babd-a658a601015e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:41.695629 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-4ae6e6cc-dab0-4ea2-babd-a658a601015e tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments/825dd313-0f0a-4eae-8324-7d8f814a84f8" status: 200 len: 194 microversion: 2.1 time: 0.054220 May 16 17:54:41.696174 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 541/1061] 10.222.0.58 () {58 vars in 1412 bytes} [Mon May 16 17:54:41 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments/825dd313-0f0a-4eae-8324-7d8f814a84f8 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:54:41.706626 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-59a57c80-04fd-4cf2-8176-45a5dd60d541 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:41.707110 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-59a57c80-04fd-4cf2-8176-45a5dd60d541 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:41.713638 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-59a57c80-04fd-4cf2-8176-45a5dd60d541 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:41.714081 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-59a57c80-04fd-4cf2-8176-45a5dd60d541 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:41.714836 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-59a57c80-04fd-4cf2-8176-45a5dd60d541 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:41.715323 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-59a57c80-04fd-4cf2-8176-45a5dd60d541 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:41.797250 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-59a57c80-04fd-4cf2-8176-45a5dd60d541 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lazy-loading 'services' on Instance uuid 40af0a2f-7793-41b9-8bde-e13572b4c287 {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:54:41.884862 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-59a57c80-04fd-4cf2-8176-45a5dd60d541 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments/825dd313-0f0a-4eae-8324-7d8f814a84f8" status: 202 len: 0 microversion: 2.1 time: 0.182024 May 16 17:54:41.885470 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 521/1062] 10.222.0.58 () {58 vars in 1415 bytes} [Mon May 16 17:54:41 2022] DELETE /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments/825dd313-0f0a-4eae-8324-7d8f814a84f8 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:54:43.017172 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-fa868aa1-bea3-4890-b4f9-7e9f724b7578 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:43.017759 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-fa868aa1-bea3-4890-b4f9-7e9f724b7578 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:43.024733 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fa868aa1-bea3-4890-b4f9-7e9f724b7578 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:43.025177 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fa868aa1-bea3-4890-b4f9-7e9f724b7578 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:43.025973 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fa868aa1-bea3-4890-b4f9-7e9f724b7578 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:43.026400 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-fa868aa1-bea3-4890-b4f9-7e9f724b7578 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:43.057351 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-fa868aa1-bea3-4890-b4f9-7e9f724b7578 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments/6b792f72-4210-4042-a272-738e8c73609f" status: 200 len: 194 microversion: 2.1 time: 0.045418 May 16 17:54:43.057968 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 542/1063] 10.222.0.58 () {58 vars in 1412 bytes} [Mon May 16 17:54:43 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments/6b792f72-4210-4042-a272-738e8c73609f => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:54:43.068614 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-3c157757-cc7c-4b24-bbaa-ada9729e9d72 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:43.069143 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-3c157757-cc7c-4b24-bbaa-ada9729e9d72 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:43.076211 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3c157757-cc7c-4b24-bbaa-ada9729e9d72 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:43.076655 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3c157757-cc7c-4b24-bbaa-ada9729e9d72 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:43.077583 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3c157757-cc7c-4b24-bbaa-ada9729e9d72 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:43.078031 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-3c157757-cc7c-4b24-bbaa-ada9729e9d72 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:43.161944 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.objects.instance [None req-3c157757-cc7c-4b24-bbaa-ada9729e9d72 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lazy-loading 'services' on Instance uuid 40af0a2f-7793-41b9-8bde-e13572b4c287 {{(pid=128816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 17:54:43.237476 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-3c157757-cc7c-4b24-bbaa-ada9729e9d72 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments/6b792f72-4210-4042-a272-738e8c73609f" status: 202 len: 0 microversion: 2.1 time: 0.173051 May 16 17:54:43.238192 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 522/1064] 10.222.0.58 () {58 vars in 1415 bytes} [Mon May 16 17:54:43 2022] DELETE /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments/6b792f72-4210-4042-a272-738e8c73609f => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 17:54:44.409036 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-814dabfe-a8ad-4d0c-9218-0f7b56824490 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:44.410022 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-814dabfe-a8ad-4d0c-9218-0f7b56824490 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:44.417384 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-814dabfe-a8ad-4d0c-9218-0f7b56824490 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:44.417855 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-814dabfe-a8ad-4d0c-9218-0f7b56824490 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:44.418631 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-814dabfe-a8ad-4d0c-9218-0f7b56824490 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:44.419073 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-814dabfe-a8ad-4d0c-9218-0f7b56824490 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:44.454559 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-814dabfe-a8ad-4d0c-9218-0f7b56824490 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049527 May 16 17:54:44.455100 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 543/1065] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:54:44 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 17:54:44.571363 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-d0d83d03-202b-47dc-aef6-6eab9f4b80d5 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:44.572436 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-d0d83d03-202b-47dc-aef6-6eab9f4b80d5 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:44.579447 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d0d83d03-202b-47dc-aef6-6eab9f4b80d5 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:44.579904 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d0d83d03-202b-47dc-aef6-6eab9f4b80d5 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:44.580681 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d0d83d03-202b-47dc-aef6-6eab9f4b80d5 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:44.581119 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-d0d83d03-202b-47dc-aef6-6eab9f4b80d5 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:44.610184 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-d0d83d03-202b-47dc-aef6-6eab9f4b80d5 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043646 May 16 17:54:44.610731 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 523/1066] 10.222.0.58 () {58 vars in 1301 bytes} [Mon May 16 17:54:44 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 17:54:44.668153 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-66702ae2-9b5d-41bd-9b30-8b82c9bb69d4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:44.668674 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-66702ae2-9b5d-41bd-9b30-8b82c9bb69d4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:44.675165 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-66702ae2-9b5d-41bd-9b30-8b82c9bb69d4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:44.675677 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-66702ae2-9b5d-41bd-9b30-8b82c9bb69d4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:44.676432 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-66702ae2-9b5d-41bd-9b30-8b82c9bb69d4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:44.676881 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-66702ae2-9b5d-41bd-9b30-8b82c9bb69d4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:44.701472 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-66702ae2-9b5d-41bd-9b30-8b82c9bb69d4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Going to try to terminate instance {{(pid=128815) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 17:54:44.786502 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-66702ae2-9b5d-41bd-9b30-8b82c9bb69d4 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287" status: 204 len: 0 microversion: 2.1 time: 0.122552 May 16 17:54:44.787189 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 544/1067] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:54:44 2022] DELETE /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 17:54:44.798004 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-992d1f35-595d-404d-8353-4775ec9955a1 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:44.798730 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-992d1f35-595d-404d-8353-4775ec9955a1 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:44.805630 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-992d1f35-595d-404d-8353-4775ec9955a1 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:44.806081 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-992d1f35-595d-404d-8353-4775ec9955a1 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:44.806842 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-992d1f35-595d-404d-8353-4775ec9955a1 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:44.807273 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-992d1f35-595d-404d-8353-4775ec9955a1 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:44.940867 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-992d1f35-595d-404d-8353-4775ec9955a1 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:54:44.952933 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-992d1f35-595d-404d-8353-4775ec9955a1 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287" status: 200 len: 1672 microversion: 2.1 time: 0.159145 May 16 17:54:44.954032 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 524/1068] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:54:44 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:54:45.977623 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-4bb483d3-b8e5-40ca-bc4d-a1b6a1303d7c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:45.978837 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-4bb483d3-b8e5-40ca-bc4d-a1b6a1303d7c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:45.987318 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4bb483d3-b8e5-40ca-bc4d-a1b6a1303d7c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:45.987711 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4bb483d3-b8e5-40ca-bc4d-a1b6a1303d7c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:45.988511 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4bb483d3-b8e5-40ca-bc4d-a1b6a1303d7c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:45.988927 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-4bb483d3-b8e5-40ca-bc4d-a1b6a1303d7c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:46.120645 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.policy [None req-4bb483d3-b8e5-40ca-bc4d-a1b6a1303d7c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128815) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:54:46.131874 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-4bb483d3-b8e5-40ca-bc4d-a1b6a1303d7c tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287" status: 200 len: 1672 microversion: 2.1 time: 0.161194 May 16 17:54:46.132666 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 545/1069] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:54:45 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:54:47.152000 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-f39fdb6d-3b9e-4c09-a1a4-799c78d9533a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:47.152584 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-f39fdb6d-3b9e-4c09-a1a4-799c78d9533a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:47.159742 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f39fdb6d-3b9e-4c09-a1a4-799c78d9533a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:47.160191 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f39fdb6d-3b9e-4c09-a1a4-799c78d9533a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:47.160963 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f39fdb6d-3b9e-4c09-a1a4-799c78d9533a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:47.161400 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-f39fdb6d-3b9e-4c09-a1a4-799c78d9533a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:47.229692 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.policy [None req-f39fdb6d-3b9e-4c09-a1a4-799c78d9533a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ca3187ddb684fd1b90463f4adf4282d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f074c24f4594fa89de6dfe2e38659c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128816) authorize /opt/stack/nova/nova/policy.py:199}} May 16 17:54:47.237420 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-f39fdb6d-3b9e-4c09-a1a4-799c78d9533a tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287" status: 200 len: 1605 microversion: 2.1 time: 0.089382 May 16 17:54:47.238261 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 525/1070] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:54:47 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 => generated 1605 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 17:54:47.296042 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [req-e3261433-84a9-4267-a7e1-f479927a6f55 req-5a6b8c30-69f5-4ed9-958e-1b7f94ef1448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40af0a2f-7793-41b9-8bde-e13572b4c287", "name": "network-vif-deleted", "tag": "30a990e5-3337-48b5-8f5b-bc59b439632c"}]} {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 17:54:47.304976 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-e3261433-84a9-4267-a7e1-f479927a6f55 req-5a6b8c30-69f5-4ed9-958e-1b7f94ef1448 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:47.305412 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [req-e3261433-84a9-4267-a7e1-f479927a6f55 req-5a6b8c30-69f5-4ed9-958e-1b7f94ef1448 service nova] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:47.317733 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.compute.server_external_events [req-e3261433-84a9-4267-a7e1-f479927a6f55 req-5a6b8c30-69f5-4ed9-958e-1b7f94ef1448 service nova] Creating event network-vif-deleted:30a990e5-3337-48b5-8f5b-bc59b439632c for instance 40af0a2f-7793-41b9-8bde-e13572b4c287 on hv-cinder-83769 May 16 17:54:47.323087 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [req-e3261433-84a9-4267-a7e1-f479927a6f55 req-5a6b8c30-69f5-4ed9-958e-1b7f94ef1448 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030667 May 16 17:54:47.323661 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 546/1071] 10.222.0.58 () {64 vars in 1317 bytes} [Mon May 16 17:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 17:54:48.254780 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c741de84-7c9c-437e-83a0-ad2273729162 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:48.255369 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-c741de84-7c9c-437e-83a0-ad2273729162 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:48.262146 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c741de84-7c9c-437e-83a0-ad2273729162 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:48.262599 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c741de84-7c9c-437e-83a0-ad2273729162 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:48.263364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c741de84-7c9c-437e-83a0-ad2273729162 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:48.263809 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-c741de84-7c9c-437e-83a0-ad2273729162 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:48.278370 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-c741de84-7c9c-437e-83a0-ad2273729162 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] HTTP exception thrown: Instance 40af0a2f-7793-41b9-8bde-e13572b4c287 could not be found. May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c741de84-7c9c-437e-83a0-ad2273729162 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Request method failure captured: May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 HTTP/1.1 May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigo70q5byKpdRG-mOODDKH4Qqwl-jFiQspbiJ4jYeACYDaa3CoHIFuhwV4Jf3m9AR4T1Ypo60r6LgGo6fmX3JVt_xTOthqKmyFqHhw3dBF-Nx1AaGbqokpLkpfAuwwSAzNC3Aj44gfoxB7T7_UwS2aUW74aG_aqegTJI-APJSBj0RUXg May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 2f074c24f4594fa89de6dfe2e38659c3 May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-AttachVolumeTestJSON-1033941299 May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:54:48.280203 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:54:48.281983 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f074c24f4594fa89de6dfe2e38659c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2f074c24f4594fa89de6dfe2e38659c3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2f074c24f4594fa89de6dfe2e38659c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f074c24f4594fa89de6dfe2e38659c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:54:48.281983 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-AttachVolumeTestJSON-1033941299 May 16 17:54:48.281983 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 2f074c24f4594fa89de6dfe2e38659c3 May 16 17:54:48.281983 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1033941299 May 16 17:54:48.281983 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-AttachVolumeTestJSON-1033941299-project May 16 17:54:48.281983 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:54:48.281983 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:54:48.281983 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 7ca3187ddb684fd1b90463f4adf4282d May 16 17:54:48.281983 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-AttachVolumeTestJSON-1033941299-project May 16 17:54:48.281983 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:54:48.281983 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance 40af0a2f-7793-41b9-8bde-e13572b4c287 could not be found. May 16 17:54:48.281983 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': '40af0a2f-7793-41b9-8bde-e13572b4c287'} May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40af0a2f-7793-41b9-8bde-e13572b4c287 could not be found. May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:54:48.282886 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:54:48.284364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:54:48.284364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:54:48.284364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:54:48.284364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:54:48.284364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:54:48.284364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:54:48.284364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:54:48.284364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40af0a2f-7793-41b9-8bde-e13572b4c287 could not be found. May 16 17:54:48.284364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:48.284364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:54:48.284364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:48.284364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:48.284364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:54:48.284364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:54:48.284364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:54:48.284364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:54:48.284364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40af0a2f-7793-41b9-8bde-e13572b4c287 could not be found. May 16 17:54:48.284364 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:48.285774 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-c741de84-7c9c-437e-83a0-ad2273729162 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Returning 404 to user: Instance 40af0a2f-7793-41b9-8bde-e13572b4c287 could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:54:48.285774 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-c741de84-7c9c-437e-83a0-ad2273729162 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287" status: 404 len: 111 microversion: 2.1 time: 0.030891 May 16 17:54:48.285774 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 526/1072] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:54:48 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:54:48.295530 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-25d0e741-61f0-4003-a3da-781bf29eaf72 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '.version_select at 0x7f79a4812dc0>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:48.315353 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-25d0e741-61f0-4003-a3da-781bf29eaf72 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462298410" status: 202 len: 0 microversion: 2.1 time: 0.024381 May 16 17:54:48.316049 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 547/1073] 10.222.0.58 () {58 vars in 1220 bytes} [Mon May 16 17:54:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462298410 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 17:54:51.210030 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-df41eec5-362d-41f5-89a8-001cc08841c3 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:51.210487 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-df41eec5-362d-41f5-89a8-001cc08841c3 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:51.217275 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-df41eec5-362d-41f5-89a8-001cc08841c3 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:51.217765 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-df41eec5-362d-41f5-89a8-001cc08841c3 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:51.218545 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-df41eec5-362d-41f5-89a8-001cc08841c3 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:51.218983 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-df41eec5-362d-41f5-89a8-001cc08841c3 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:51.232822 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-df41eec5-362d-41f5-89a8-001cc08841c3 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] HTTP exception thrown: Instance 40af0a2f-7793-41b9-8bde-e13572b4c287 could not be found. May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-df41eec5-362d-41f5-89a8-001cc08841c3 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Request method failure captured: May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: DELETE /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 HTTP/1.1 May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigo70q5byKpdRG-mOODDKH4Qqwl-jFiQspbiJ4jYeACYDaa3CoHIFuhwV4Jf3m9AR4T1Ypo60r6LgGo6fmX3JVt_xTOthqKmyFqHhw3dBF-Nx1AaGbqokpLkpfAuwwSAzNC3Aj44gfoxB7T7_UwS2aUW74aG_aqegTJI-APJSBj0RUXg May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 2f074c24f4594fa89de6dfe2e38659c3 May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-AttachVolumeTestJSON-1033941299 May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:54:51.234503 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:54:51.236072 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f074c24f4594fa89de6dfe2e38659c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2f074c24f4594fa89de6dfe2e38659c3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2f074c24f4594fa89de6dfe2e38659c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f074c24f4594fa89de6dfe2e38659c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:54:51.236072 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-AttachVolumeTestJSON-1033941299 May 16 17:54:51.236072 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 2f074c24f4594fa89de6dfe2e38659c3 May 16 17:54:51.236072 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1033941299 May 16 17:54:51.236072 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-AttachVolumeTestJSON-1033941299-project May 16 17:54:51.236072 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:54:51.236072 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:54:51.236072 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 7ca3187ddb684fd1b90463f4adf4282d May 16 17:54:51.236072 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-AttachVolumeTestJSON-1033941299-project May 16 17:54:51.236072 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:54:51.236072 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance 40af0a2f-7793-41b9-8bde-e13572b4c287 could not be found. May 16 17:54:51.236072 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': '40af0a2f-7793-41b9-8bde-e13572b4c287'} May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40af0a2f-7793-41b9-8bde-e13572b4c287 could not be found. May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:54:51.237158 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40af0a2f-7793-41b9-8bde-e13572b4c287 could not be found. May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40af0a2f-7793-41b9-8bde-e13572b4c287 could not be found. May 16 17:54:51.238764 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:51.240447 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-df41eec5-362d-41f5-89a8-001cc08841c3 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Returning 404 to user: Instance 40af0a2f-7793-41b9-8bde-e13572b4c287 could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:54:51.240447 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-df41eec5-362d-41f5-89a8-001cc08841c3 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287" status: 404 len: 111 microversion: 2.1 time: 0.029888 May 16 17:54:51.240447 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 527/1074] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:54:51 2022] DELETE /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:54:51.244993 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-11acd05c-28ce-4e61-9a8a-2060d0e9ca8d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:51.245776 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-11acd05c-28ce-4e61-9a8a-2060d0e9ca8d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 40af0a2f-7793-41b9-8bde-e13572b4c287] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:51.252654 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-11acd05c-28ce-4e61-9a8a-2060d0e9ca8d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:51.253107 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-11acd05c-28ce-4e61-9a8a-2060d0e9ca8d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:51.253905 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-11acd05c-28ce-4e61-9a8a-2060d0e9ca8d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:51.254329 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-11acd05c-28ce-4e61-9a8a-2060d0e9ca8d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:51.269789 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-11acd05c-28ce-4e61-9a8a-2060d0e9ca8d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] HTTP exception thrown: Instance 40af0a2f-7793-41b9-8bde-e13572b4c287 could not be found. May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-11acd05c-28ce-4e61-9a8a-2060d0e9ca8d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Request method failure captured: May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 HTTP/1.1 May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigo70q5byKpdRG-mOODDKH4Qqwl-jFiQspbiJ4jYeACYDaa3CoHIFuhwV4Jf3m9AR4T1Ypo60r6LgGo6fmX3JVt_xTOthqKmyFqHhw3dBF-Nx1AaGbqokpLkpfAuwwSAzNC3Aj44gfoxB7T7_UwS2aUW74aG_aqegTJI-APJSBj0RUXg May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 2f074c24f4594fa89de6dfe2e38659c3 May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-AttachVolumeTestJSON-1033941299 May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:54:51.271440 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:54:51.273071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f074c24f4594fa89de6dfe2e38659c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2f074c24f4594fa89de6dfe2e38659c3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2f074c24f4594fa89de6dfe2e38659c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f074c24f4594fa89de6dfe2e38659c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:54:51.273071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-AttachVolumeTestJSON-1033941299 May 16 17:54:51.273071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 2f074c24f4594fa89de6dfe2e38659c3 May 16 17:54:51.273071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1033941299 May 16 17:54:51.273071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-AttachVolumeTestJSON-1033941299-project May 16 17:54:51.273071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:54:51.273071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:54:51.273071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: 7ca3187ddb684fd1b90463f4adf4282d May 16 17:54:51.273071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-AttachVolumeTestJSON-1033941299-project May 16 17:54:51.273071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:54:51.273071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance 40af0a2f-7793-41b9-8bde-e13572b4c287 could not be found. May 16 17:54:51.273071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': '40af0a2f-7793-41b9-8bde-e13572b4c287'} May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40af0a2f-7793-41b9-8bde-e13572b4c287 could not be found. May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:54:51.274071 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:54:51.275326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:54:51.275326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:54:51.275326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:54:51.275326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:54:51.275326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:54:51.275326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:54:51.275326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:54:51.275326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40af0a2f-7793-41b9-8bde-e13572b4c287 could not be found. May 16 17:54:51.275326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:51.275326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:54:51.275326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:51.275326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:51.275326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:54:51.275326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:54:51.275326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:54:51.275326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:54:51.275326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40af0a2f-7793-41b9-8bde-e13572b4c287 could not be found. May 16 17:54:51.275326 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:51.276538 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-11acd05c-28ce-4e61-9a8a-2060d0e9ca8d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Returning 404 to user: Instance 40af0a2f-7793-41b9-8bde-e13572b4c287 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:54:51.276538 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-11acd05c-28ce-4e61-9a8a-2060d0e9ca8d tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287" status: 404 len: 111 microversion: 2.1 time: 0.032242 May 16 17:54:51.276538 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 548/1075] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:54:51 2022] GET /compute/v2.1/servers/40af0a2f-7793-41b9-8bde-e13572b4c287 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:54:52.421288 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-661ad1d5-8932-4815-a66d-a2f302659e59 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:52.421901 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.compute.api [None req-661ad1d5-8932-4815-a66d-a2f302659e59 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128816) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:52.428681 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-661ad1d5-8932-4815-a66d-a2f302659e59 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:52.429137 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-661ad1d5-8932-4815-a66d-a2f302659e59 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:52.429948 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-661ad1d5-8932-4815-a66d-a2f302659e59 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:52.430387 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG oslo_concurrency.lockutils [None req-661ad1d5-8932-4815-a66d-a2f302659e59 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:52.444721 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.wsgi [None req-661ad1d5-8932-4815-a66d-a2f302659e59 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] HTTP exception thrown: Instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 could not be found. May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-661ad1d5-8932-4815-a66d-a2f302659e59 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Request method failure captured: May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: request: DELETE /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 HTTP/1.1 May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept: application/json May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Accept-Encoding: identity May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Connection: close May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Length: 0 May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Content-Type: application/json May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Host: 10.222.0.58 May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Openstack-System-Scope: None May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: User-Agent: python-urllib3/1.26.9 May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Auth-Token: gAAAAABigo70q5byKpdRG-mOODDKH4Qqwl-jFiQspbiJ4jYeACYDaa3CoHIFuhwV4Jf3m9AR4T1Ypo60r6LgGo6fmX3JVt_xTOthqKmyFqHhw3dBF-Nx1AaGbqokpLkpfAuwwSAzNC3Aj44gfoxB7T7_UwS2aUW74aG_aqegTJI-APJSBj0RUXg May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Id: None May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Domain-Name: None May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Identity-Status: Confirmed May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Is-Admin-Project: True May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Id: default May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Domain-Name: Default May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Id: 2f074c24f4594fa89de6dfe2e38659c3 May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Project-Name: tempest-AttachVolumeTestJSON-1033941299 May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Role: reader,member May 16 17:54:52.446310 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Roles: reader,member May 16 17:54:52.447903 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f074c24f4594fa89de6dfe2e38659c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2f074c24f4594fa89de6dfe2e38659c3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2f074c24f4594fa89de6dfe2e38659c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f074c24f4594fa89de6dfe2e38659c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:54:52.447903 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant: tempest-AttachVolumeTestJSON-1033941299 May 16 17:54:52.447903 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Id: 2f074c24f4594fa89de6dfe2e38659c3 May 16 17:54:52.447903 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1033941299 May 16 17:54:52.447903 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User: tempest-AttachVolumeTestJSON-1033941299-project May 16 17:54:52.447903 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Id: default May 16 17:54:52.447903 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Domain-Name: Default May 16 17:54:52.447903 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Id: 7ca3187ddb684fd1b90463f4adf4282d May 16 17:54:52.447903 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: X-User-Name: tempest-AttachVolumeTestJSON-1033941299-project May 16 17:54:52.447903 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: method: > May 16 17:54:52.447903 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: exception: Instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 could not be found. May 16 17:54:52.447903 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: action_args: {'id': '1d10f518-50e7-4bee-ba5b-210786b1b1b9'} May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: {{(pid=128816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 could not be found. May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:54:52.448821 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 could not be found. May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 could not be found. May 16 17:54:52.450440 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: ERROR nova.api.openstack.wsgi May 16 17:54:52.452027 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: DEBUG nova.api.openstack.wsgi [None req-661ad1d5-8932-4815-a66d-a2f302659e59 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Returning 404 to user: Instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 could not be found. {{(pid=128816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:54:52.452027 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO nova.api.openstack.requestlog [None req-661ad1d5-8932-4815-a66d-a2f302659e59 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 404 len: 111 microversion: 2.1 time: 0.030386 May 16 17:54:52.452027 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: [pid: 128816|app: 0|req: 528/1076] 10.222.0.58 () {58 vars in 1238 bytes} [Mon May 16 17:54:52 2022] DELETE /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:54:52.457718 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-55e90254-aa4b-49ef-a098-3c4fc89d7e69 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Calling method '>' {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 17:54:52.458349 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.compute.api [None req-55e90254-aa4b-49ef-a098-3c4fc89d7e69 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] [instance: 1d10f518-50e7-4bee-ba5b-210786b1b1b9] Fetching instance by UUID {{(pid=128815) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 17:54:52.465281 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55e90254-aa4b-49ef-a098-3c4fc89d7e69 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:52.465689 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55e90254-aa4b-49ef-a098-3c4fc89d7e69 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:52.466469 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55e90254-aa4b-49ef-a098-3c4fc89d7e69 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 17:54:52.466895 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG oslo_concurrency.lockutils [None req-55e90254-aa4b-49ef-a098-3c4fc89d7e69 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Lock "8e1c4446-23c6-4b82-8040-1fc724b16042" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 17:54:52.481534 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.wsgi [None req-55e90254-aa4b-49ef-a098-3c4fc89d7e69 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] HTTP exception thrown: Instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 could not be found. May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-55e90254-aa4b-49ef-a098-3c4fc89d7e69 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Request method failure captured: May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: request: GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 HTTP/1.1 May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept: application/json May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Accept-Encoding: identity May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Connection: close May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Length: 0 May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Content-Type: application/json May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Host: 10.222.0.58 May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Openstack-System-Scope: None May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: User-Agent: python-urllib3/1.26.9 May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Auth-Token: gAAAAABigo70q5byKpdRG-mOODDKH4Qqwl-jFiQspbiJ4jYeACYDaa3CoHIFuhwV4Jf3m9AR4T1Ypo60r6LgGo6fmX3JVt_xTOthqKmyFqHhw3dBF-Nx1AaGbqokpLkpfAuwwSAzNC3Aj44gfoxB7T7_UwS2aUW74aG_aqegTJI-APJSBj0RUXg May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Id: None May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Domain-Name: None May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Identity-Status: Confirmed May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Is-Admin-Project: True May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Id: default May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Domain-Name: Default May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Id: 2f074c24f4594fa89de6dfe2e38659c3 May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Project-Name: tempest-AttachVolumeTestJSON-1033941299 May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Role: reader,member May 16 17:54:52.483105 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Roles: reader,member May 16 17:54:52.484775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f074c24f4594fa89de6dfe2e38659c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2f074c24f4594fa89de6dfe2e38659c3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2f074c24f4594fa89de6dfe2e38659c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f074c24f4594fa89de6dfe2e38659c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] May 16 17:54:52.484775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant: tempest-AttachVolumeTestJSON-1033941299 May 16 17:54:52.484775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Id: 2f074c24f4594fa89de6dfe2e38659c3 May 16 17:54:52.484775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1033941299 May 16 17:54:52.484775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User: tempest-AttachVolumeTestJSON-1033941299-project May 16 17:54:52.484775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Id: default May 16 17:54:52.484775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Domain-Name: Default May 16 17:54:52.484775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Id: 7ca3187ddb684fd1b90463f4adf4282d May 16 17:54:52.484775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: X-User-Name: tempest-AttachVolumeTestJSON-1033941299-project May 16 17:54:52.484775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: method: > May 16 17:54:52.484775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: exception: Instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 could not be found. May 16 17:54:52.484775 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: action_args: {'id': '1d10f518-50e7-4bee-ba5b-210786b1b1b9'} May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: {{(pid=128815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 could not be found. May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 17:54:52.485845 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 17:54:52.487887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 17:54:52.487887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 17:54:52.487887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 17:54:52.487887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 17:54:52.487887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 17:54:52.487887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 17:54:52.487887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 17:54:52.487887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 could not be found. May 16 17:54:52.487887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:52.487887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 17:54:52.487887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:52.487887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 17:54:52.487887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 17:54:52.487887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 17:54:52.487887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 17:54:52.487887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 17:54:52.487887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 could not be found. May 16 17:54:52.487887 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: ERROR nova.api.openstack.wsgi May 16 17:54:52.489686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: DEBUG nova.api.openstack.wsgi [None req-55e90254-aa4b-49ef-a098-3c4fc89d7e69 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] Returning 404 to user: Instance 1d10f518-50e7-4bee-ba5b-210786b1b1b9 could not be found. {{(pid=128815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 17:54:52.489686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO nova.api.openstack.requestlog [None req-55e90254-aa4b-49ef-a098-3c4fc89d7e69 tempest-AttachVolumeTestJSON-1033941299 tempest-AttachVolumeTestJSON-1033941299-project] 10.222.0.58 "GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9" status: 404 len: 111 microversion: 2.1 time: 0.031041 May 16 17:54:52.489686 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: [pid: 128815|app: 0|req: 549/1077] 10.222.0.58 () {58 vars in 1235 bytes} [Mon May 16 17:54:52 2022] GET /compute/v2.1/servers/1d10f518-50e7-4bee-ba5b-210786b1b1b9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 17:56:39.971480 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:56:39.972380 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Mon May 16 17:56:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:56:52.232077 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:56:52.232574 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Mon May 16 17:56:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 17:59:59.984625 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 17:59:59.985329 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Mon May 16 17:59:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 18:00:08.125871 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 18:00:08.126853 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Mon May 16 18:00:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 18:00:09.873746 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 18:00:09.874727 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Mon May 16 18:00:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 18:00:12.034711 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 18:00:12.035676 dv-cinder-837699-6-iscsi devstack@n-api.service[128816]: Mon May 16 18:00:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 18:00:12.241991 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 18:00:12.242462 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Mon May 16 18:00:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 18:00:23.268945 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 18:00:23.269576 dv-cinder-837699-6-iscsi devstack@n-api.service[128815]: Mon May 16 18:00:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!